-- Logs begin at Tue 2022-04-05 10:35:12 UTC, end at Tue 2022-04-05 11:53:38 UTC. -- Apr 05 11:24:24.210244 dv-cinder-834448-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:24:24.218020 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:24:24 2022] *** Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: nodename: dv-cinder-834448-3-iscsi Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: machine: x86_64 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: clock source: unix Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: pcre jit disabled Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: detected number of CPU cores: 4 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: current working directory: / Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: your processes number limit is 47680 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: your memory page size is 4096 bytes Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: detected max file descriptor number: 2048 Apr 05 11:24:24.221173 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: lock engine: pthread robust mutexes Apr 05 11:24:24.222085 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: thunder lock: enabled Apr 05 11:24:24.222085 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:24:24.222085 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:24:24.266409 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: Python main interpreter initialized at 0x5595039279c0 Apr 05 11:24:24.266409 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: python threads support enabled Apr 05 11:24:24.266409 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: your server socket listen backlog is limited to 100 connections Apr 05 11:24:24.266409 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:24:24.266760 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:24:24.266833 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: *** Operational MODE: preforking *** Apr 05 11:24:24.267079 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:24:24.267079 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: spawned uWSGI master process (pid: 103202) Apr 05 11:24:24.267274 dv-cinder-834448-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:24:24.268681 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: spawned uWSGI worker 1 (pid: 103203, cores: 1) Apr 05 11:24:24.268681 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: spawned uWSGI worker 2 (pid: 103204, cores: 1) Apr 05 11:24:24.268681 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:24:25.474526 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:24:25.490289 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:24:26.336342 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:24:26.336342 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: from cryptography.utils import int_from_bytes Apr 05 11:24:26.336673 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:24:26.336673 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: from cryptography.utils import int_from_bytes Apr 05 11:24:26.338283 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:24:26.338283 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: from cryptography.utils import int_from_bytes Apr 05 11:24:26.338613 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:24:26.338613 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: from cryptography.utils import int_from_bytes Apr 05 11:24:28.944619 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:24:28.945167 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:24:28.945264 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:24:28.945264 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:24:28.945659 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:24:28.945734 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:24:28.945812 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:24:28.945974 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:24:28.946057 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:24:28.946243 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:24:28.946337 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.946633 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.946727 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.946980 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947073 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947276 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947370 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947629 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947717 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.947944 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948030 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948263 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948355 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948582 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948667 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.948908 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949044 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949165 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949265 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949480 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949563 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949795 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.949897 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834448-3-iscsi {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950110 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950207 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834448-3-iscsi {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950416 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950505 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950723 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.950812 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951036 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951129 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951337 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951447 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951687 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951773 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.951996 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.952079 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.952305 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.952494 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.952828 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.952973 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953150 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953262 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953460 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953569 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953772 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.953890 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954113 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954195 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954431 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954514 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954744 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.954839 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955046 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955179 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955363 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955465 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955708 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.955803 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956016 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956111 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834448-3-iscsi {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956406 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956495 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834448-3-iscsi {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956719 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.956812 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957041 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957139 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957376 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957469 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957746 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.957840 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.958054 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.958138 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.958941 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959107 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959338 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959454 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959623 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959709 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.959943 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960046 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960273 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960365 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960592 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960676 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.960912 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961004 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961235 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961323 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961542 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961633 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961850 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.961940 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962160 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962251 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962484 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962578 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962793 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.962886 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963101 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963185 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963356 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963460 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963696 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.963845 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964021 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964190 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964345 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964514 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964658 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964773 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.964912 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965026 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965169 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965345 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965491 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965667 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965816 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.965979 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966128 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966288 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966438 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966595 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966750 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.966909 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.967319 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.967499 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.967660 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.967784 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968000 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968094 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968313 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968405 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968623 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968705 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.968945 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969029 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969265 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969349 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969583 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969672 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.969891 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970065 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970211 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970304 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970519 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970602 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970828 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.970913 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971153 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971247 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971495 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971584 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971807 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.971901 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972123 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972207 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972438 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972520 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972746 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.972838 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973054 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973144 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973360 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973451 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973679 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.973774 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974095 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974577 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974667 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974756 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974833 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974918 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.974996 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975078 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975155 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975364 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975477 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975697 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.975781 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976018 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976101 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976330 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976423 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976639 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976724 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.976947 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977037 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977251 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977342 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977556 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977639 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977861 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.977942 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978163 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978253 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978465 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978555 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978768 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.978857 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979068 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979163 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979374 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979503 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979707 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.979790 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980017 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980151 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980320 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980403 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980624 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980717 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.980927 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981012 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981232 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981320 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981535 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981627 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981840 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.981935 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982144 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982328 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982451 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982536 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982753 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.982844 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983058 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983142 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983366 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983469 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983699 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.983786 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984022 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984112 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984330 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984421 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984639 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984724 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.984940 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985029 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985249 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985345 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985550 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985633 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985855 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.985945 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986157 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986253 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986460 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986544 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986763 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.986854 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987064 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987156 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987366 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987522 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987694 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987781 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.987992 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988085 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988294 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988384 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988597 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988680 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988903 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.988996 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.989205 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.989287 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.989524 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.989776 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.990158 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.990313 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.990398 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.990496 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.990572 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.990655 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:24:28.990829 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.990955 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991146 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991277 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991504 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991635 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991840 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.991950 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992159 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992287 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992472 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992646 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992787 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.992973 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993114 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993290 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993426 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993607 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993738 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.993935 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994047 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994248 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994365 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994561 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994683 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.994877 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995012 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995186 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995327 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995529 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995669 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995864 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.995986 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996184 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996296 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996506 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996613 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996826 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.996945 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997141 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997267 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997467 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997579 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997797 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.997918 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998124 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998260 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998439 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998572 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998783 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.998895 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999130 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999222 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999471 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999559 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999824 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:28.999908 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000128 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000222 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000450 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000542 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000759 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.000842 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001071 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001162 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001388 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001490 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001699 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.001785 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002009 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002103 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002318 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002402 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002626 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002709 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.002933 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003018 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003242 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003324 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003593 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003704 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.003908 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004000 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004217 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004312 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004535 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004619 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004845 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.004929 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.005684 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.005861 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006195 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006364 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006476 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006564 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006642 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006725 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006892 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.006984 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007200 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007285 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007527 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007616 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007839 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.007936 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008151 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008261 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008455 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008545 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008772 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.008864 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009078 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009169 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009388 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009473 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009698 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.009795 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010008 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010099 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010314 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010400 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010622 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010718 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.010927 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011011 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011229 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011314 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011565 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011653 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011879 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.011963 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012182 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012294 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012503 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012589 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012807 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.012891 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013111 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013193 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013420 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013504 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013724 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.013807 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014029 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014118 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014339 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014425 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014646 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014728 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.014958 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015051 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015265 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015348 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015597 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015684 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.015925 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016021 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016239 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016330 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016540 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016629 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016870 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.016963 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017193 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017277 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017509 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017599 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017815 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.017911 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018126 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018211 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018430 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018514 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018735 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.018820 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019040 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019129 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019344 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019515 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019672 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019759 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.019974 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.020056 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.020272 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.020355 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.020575 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.020660 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.021445 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.021918 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.021918 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022127 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022127 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022352 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022428 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022503 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022661 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022777 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.022964 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023092 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023307 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023391 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023639 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023737 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.023984 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024069 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024318 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024401 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024628 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024723 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.024945 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025028 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025254 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025338 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025572 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025665 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025884 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.025968 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026196 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026288 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026507 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026593 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026817 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.026899 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027131 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027218 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027454 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027553 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027773 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.027863 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028080 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028163 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028390 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028474 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028700 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.028783 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029008 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029090 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029308 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029392 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029622 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029706 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.029939 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030021 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030246 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030330 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030561 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030644 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030888 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.030978 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031198 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031284 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031536 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031623 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031849 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.031946 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032158 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032240 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032464 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032548 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032773 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.032865 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033085 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033176 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033389 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033478 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033696 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.033787 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034000 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034082 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034308 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034392 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034615 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034699 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.034923 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035005 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035221 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035303 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035557 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035648 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035877 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.035969 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.036181 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.036272 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.036546 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.036954 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.036954 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037358 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037435 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037511 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037597 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037825 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.037910 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038136 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038228 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038440 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038525 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038744 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.038827 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039052 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039136 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039366 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039464 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039697 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.039780 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040003 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040088 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040302 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040385 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040616 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040708 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.040924 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041012 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041228 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041315 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041528 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041612 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041837 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.041930 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042145 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042280 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042453 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042537 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042755 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.042851 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043068 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043153 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043370 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043509 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043698 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.043800 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044021 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044105 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044330 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044423 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044633 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044730 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.044930 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045013 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045232 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045315 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045544 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045636 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045850 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.045934 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046153 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046235 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046455 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046547 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046776 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.046860 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047081 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047166 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047384 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047486 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047712 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.047796 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048018 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048102 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048330 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048423 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048641 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.048725 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049021 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049115 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049246 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049331 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049553 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049638 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049861 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.049958 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050167 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050250 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050478 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050562 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050780 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.050910 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051086 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051171 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051391 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051542 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051730 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.051832 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.052564 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.052779 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053203 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053292 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053377 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053468 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053692 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.053779 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054026 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054116 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054344 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054617 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054702 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.054958 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055042 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055275 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055448 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055621 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055706 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.055946 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056031 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056269 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056367 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056580 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056673 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056893 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.056985 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057197 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057281 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057504 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057602 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057813 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.057897 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058117 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058202 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058421 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058513 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058724 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.058809 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059028 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059110 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059325 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059438 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059653 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059748 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.059956 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060047 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060257 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060353 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060563 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060655 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060863 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.060946 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061167 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061251 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061466 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061555 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061774 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.061864 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062079 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062163 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062381 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062465 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062682 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062765 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.062985 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063070 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063286 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063369 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063618 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063706 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.063926 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064011 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064272 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064357 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064579 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064670 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064898 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.064981 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065203 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065293 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065526 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065618 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065830 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.065922 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066134 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066224 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066444 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066536 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066747 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.066837 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.067049 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.067131 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.067350 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.067453 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.067758 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.068459 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.068850 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.068936 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069023 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069103 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069179 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069347 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069439 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069651 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069746 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.069960 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070046 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070265 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070349 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070580 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070674 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070890 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.070975 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071193 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071284 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071520 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071623 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071827 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.071910 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072130 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072213 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072433 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072519 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072739 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.072872 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073035 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073119 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073342 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073434 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073641 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073732 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.073943 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074027 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074244 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074328 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074547 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074630 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074849 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.074951 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075148 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075232 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075477 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075564 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075782 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.075881 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076081 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076165 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076389 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076473 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076690 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076786 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.076989 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077078 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077291 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077376 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077591 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077681 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077897 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.077989 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078204 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078287 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078503 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078632 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078811 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.078897 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079113 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079197 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079439 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079538 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079735 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.079820 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080037 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080120 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080334 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080423 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080635 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080727 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.080932 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081015 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081231 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081316 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081530 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081620 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081833 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.081927 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082135 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082276 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082437 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082522 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082738 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.082831 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.083038 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.083125 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.083397 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.083610 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084090 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084191 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084286 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084373 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084451 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084585 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084731 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.084902 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085039 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085224 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085355 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085537 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085678 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085846 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.085993 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086159 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086304 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086469 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086619 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086783 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.086925 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087092 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087240 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087405 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087575 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087733 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.087889 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088037 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088194 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088358 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088506 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088670 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088828 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.088978 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089141 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089296 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089452 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089618 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089775 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.089941 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090098 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090245 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090424 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090553 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090729 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.090863 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091040 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091170 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091353 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091498 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091687 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.091808 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092253 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092515 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092608 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092687 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092860 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.092952 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093171 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093265 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093482 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093568 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093795 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.093880 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094105 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094191 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094410 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094509 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094715 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.094800 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095020 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095105 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095324 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095409 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095650 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095735 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.095957 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096054 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096264 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096357 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096570 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096654 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096869 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.096955 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097177 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097309 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097484 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097578 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097879 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.097979 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098181 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098266 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098488 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098584 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098797 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.098908 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099355 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099567 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099650 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099805 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099886 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.099987 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.100161 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.100309 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.100471 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.100621 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.100780 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101042 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101127 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101359 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101506 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101665 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101749 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.101973 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102057 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102276 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102373 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102582 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102665 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102884 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.102968 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103186 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103289 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103528 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103631 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103833 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.103926 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104139 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104232 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104465 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104550 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104773 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.104856 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105098 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105191 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105517 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105601 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105822 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.105907 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106129 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106226 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106451 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106541 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106771 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.106856 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107093 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107179 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107395 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107545 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107727 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.107814 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108034 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108128 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108356 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108444 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108678 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108763 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.108984 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109070 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109296 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109382 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109598 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109691 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.109915 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110002 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110231 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110316 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110536 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110619 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110851 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.110943 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111172 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111257 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111516 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111666 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111842 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.111980 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112256 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112349 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112582 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112669 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112895 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.112988 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113197 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113280 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113506 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113596 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113810 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.113896 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.114112 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.114196 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.114420 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115013 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115536 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115629 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115709 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115799 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.115883 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116121 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116216 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116430 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116525 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116740 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.116835 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117051 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117145 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117352 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117479 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117657 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117751 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.117964 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118053 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118281 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118364 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118585 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118669 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118891 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.118977 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119213 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119298 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119545 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119637 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119851 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.119939 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120154 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120239 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120456 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120552 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120785 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.120870 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121089 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121174 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121390 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121490 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121696 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.121782 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122035 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122130 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122340 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122431 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122663 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122749 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.122984 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123068 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123299 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123392 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123639 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123728 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.123960 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124044 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124263 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124358 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124565 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124650 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124873 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.124957 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125200 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125288 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125502 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125594 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125803 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.125887 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126111 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126197 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126417 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126503 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126720 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.126811 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127020 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127106 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127327 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127446 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127658 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127747 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.127962 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128050 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128267 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128353 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128593 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128695 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128906 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.128995 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129229 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129314 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129538 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129631 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129844 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.129936 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.130226 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.130965 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131447 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131551 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131635 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131786 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131913 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.131998 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132220 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132317 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132547 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132632 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132864 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.132950 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133190 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133275 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133504 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133592 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133829 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.133915 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134148 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134242 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134465 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134577 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134782 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.134955 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135098 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135267 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135439 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135610 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135752 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.135926 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.136067 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.136241 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.136377 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.136694 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.136778 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137009 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137095 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137326 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137410 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137684 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137849 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.137998 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138181 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138312 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138498 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138626 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138814 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.138941 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139135 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139259 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139471 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139562 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139791 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.139891 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140106 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140192 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140416 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140501 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140729 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.140816 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141040 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141133 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141367 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141459 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141687 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.141779 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142016 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142100 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142331 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142428 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142653 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142747 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.142969 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143055 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143281 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143374 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143622 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143709 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.143938 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144024 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144254 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144349 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144566 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144651 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144875 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.144960 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.145189 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.145276 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.145502 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.145587 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.145845 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146346 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146445 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146527 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146605 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146690 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146770 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.146856 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147064 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147158 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147374 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147483 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147712 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.147880 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148021 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148106 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148334 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148419 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148649 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148746 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.148980 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149166 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149296 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149480 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149612 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149815 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.149931 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.150139 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.150450 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.150536 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.150764 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.150862 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151081 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151167 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151406 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151541 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151734 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.151821 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152040 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152124 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152350 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152437 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152660 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152745 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.152963 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153048 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153265 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153357 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153577 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153662 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153878 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.153971 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.154180 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.154272 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.154490 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.154575 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.154800 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155024 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155110 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155370 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155545 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155710 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.155797 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156036 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156247 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156363 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156595 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156680 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156911 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.156996 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157239 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157325 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157569 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157654 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157871 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.157956 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158185 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158270 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158492 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158576 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158814 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.158899 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159116 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159202 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159442 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159530 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159765 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.159850 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160075 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160163 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160384 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160472 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160700 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.160801 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.161012 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.161097 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.161319 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.161445 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.161703 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162191 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162280 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162365 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162452 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162533 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162610 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162699 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.162886 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163023 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163196 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163335 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163535 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163667 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163844 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.163980 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164154 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164355 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164449 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164669 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164766 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.164974 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165066 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165337 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165435 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165644 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165730 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.165951 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166039 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166263 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166356 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166569 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166715 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.166880 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167077 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167233 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167384 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167581 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167745 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.167889 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168074 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168176 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168414 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168507 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168727 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.168814 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169037 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169130 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169382 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169469 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169697 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.169786 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.170041 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.170337 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.170425 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.170701 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.170880 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171026 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171219 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171389 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171569 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171793 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.171945 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172108 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172320 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172471 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172633 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172781 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.172943 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173137 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173276 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173477 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173564 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173787 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.173886 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174120 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174216 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174451 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174540 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174763 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.174849 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175116 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175203 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175457 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175546 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175757 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.175843 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176061 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176147 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176369 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176454 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176680 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.176766 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.177487 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.177583 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178104 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178195 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178321 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178487 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178572 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178812 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.178907 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179137 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179222 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179493 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179584 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179818 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.179915 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180131 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180216 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180442 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180529 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180751 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.180850 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181062 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181146 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181375 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181461 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181683 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181767 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.181989 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182081 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182316 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182437 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182625 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182724 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.182999 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183092 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183318 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183403 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183652 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183737 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.183973 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184071 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184285 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184370 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184591 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184674 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184909 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.184996 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185218 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185304 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185538 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185621 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185851 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.185938 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186182 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186267 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186501 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186585 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186805 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.186891 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187108 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187200 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187436 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187538 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187744 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.187830 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188052 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188186 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188358 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188451 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188660 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188746 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.188963 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189047 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189267 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189366 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189565 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189648 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189865 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.189949 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190168 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190253 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190466 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190549 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190767 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.190850 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191064 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191149 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191365 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191493 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191691 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191777 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.191992 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.192085 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.192292 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.192378 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.192593 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.193291 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.193758 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.193843 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.193922 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194046 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194131 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194209 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194379 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194466 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194687 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194784 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.194993 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195091 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195302 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195395 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195634 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195724 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.195971 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196073 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196308 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196404 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196615 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196700 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.196938 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197030 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197245 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197328 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197566 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197659 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197874 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.197959 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198189 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198285 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198498 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198584 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198812 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.198906 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199123 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199207 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199465 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199571 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199763 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.199889 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200071 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200157 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200377 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200474 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200684 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200780 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.200990 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201075 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201301 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201394 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201602 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201686 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.201924 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202016 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202229 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202322 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202544 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202629 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202856 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.202941 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203164 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203257 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203511 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203598 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203820 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.203904 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204126 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204213 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204438 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204523 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204744 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.204830 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205050 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205136 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205361 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205445 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205670 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205754 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.205985 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206070 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206302 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206387 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206622 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206713 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.206947 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207038 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207270 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207354 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207616 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207780 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.207969 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.208055 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.208319 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.208510 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.208995 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209088 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209176 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209255 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209331 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209444 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:24:29.209560 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.209878 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.210185 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:24:29.210431 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:24:29.232778 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.233988 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_db.sqlalchemy.engines [None req-fbda086c-358a-4970-aead-018a950aa599 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.295933 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.context [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd(cell1) {{(pid=103204) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:24:29.297676 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.context [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd(cell1) {{(pid=103203) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:24:29.300319 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.301850 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.301950 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.303255 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.304668 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.305234 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_concurrency.lockutils [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.305470 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.307400 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.317550 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.320811 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.324603 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_db.sqlalchemy.engines [None req-fbda086c-358a-4970-aead-018a950aa599 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.325467 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_db.sqlalchemy.engines [None req-fbda086c-358a-4970-aead-018a950aa599 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.481213 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG oslo_db.sqlalchemy.engines [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:29.487070 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_db.sqlalchemy.engines [None req-fbda086c-358a-4970-aead-018a950aa599 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:24:30.008445 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:24:30.015144 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:24:30.033874 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: WARNING keystonemiddleware.auth_token [None req-fbda086c-358a-4970-aead-018a950aa599 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:24:30.040892 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: WARNING keystonemiddleware.auth_token [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:24:30.247111 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:24:30.252369 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: WARNING keystonemiddleware.auth_token [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:24:30.258255 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595039279c0 pid: 103204 (default app) Apr 05 11:24:30.260342 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:30.261516 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Apr 05 11:24:30.261935 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Tue Apr 5 11:24:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:30.269726 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: WARNING keystonemiddleware.auth_token [None req-fbda086c-358a-4970-aead-018a950aa599 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:24:30.275690 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: WARNING keystonemiddleware.auth_token [None req-fbda086c-358a-4970-aead-018a950aa599 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:24:30.281027 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595039279c0 pid: 103203 (default app) Apr 05 11:25:53.844817 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:53.846200 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Apr 05 11:25:53.846585 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:54.289520 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-be0a440e-73a6-45d2-b75e-6f702e0a9d63 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:54.319655 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-be0a440e-73a6-45d2-b75e-6f702e0a9d63 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465036 Apr 05 11:25:54.320601 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Apr 5 11:25:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:56.708227 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:56.709256 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4f80c6e9-45bb-4178-b939-caf04135b02c None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 05 11:25:56.709837 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:56.770570 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-491ca7da-af6e-4c76-abc8-9d1d33b91952 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "disk": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:56.788825 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:25:56.788825 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:25:56.887813 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-491ca7da-af6e-4c76-abc8-9d1d33b91952 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171386 Apr 05 11:25:56.888595 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:25:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:25:57.114726 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-14816016-17bf-404c-a3da-1bf24aa61e69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:57.117453 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:25:57.117453 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: warnings.warn(msg) Apr 05 11:25:57.236923 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-14816016-17bf-404c-a3da-1bf24aa61e69 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339453 Apr 05 11:25:57.237813 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Apr 5 11:25:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:59.647878 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-491ca7da-af6e-4c76-abc8-9d1d33b91952 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:59.649574 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-491ca7da-af6e-4c76-abc8-9d1d33b91952 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 Apr 05 11:25:59.650269 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:59.772986 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-65129574-6b57-4889-8ee6-842256e44ac5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:59.795058 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:25:59.795058 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: warnings.warn(msg) Apr 05 11:25:59.882005 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-65129574-6b57-4889-8ee6-842256e44ac5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225021 Apr 05 11:25:59.882816 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:25:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:25:59.895144 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-bce78115-51eb-4aee-9cc7-62c76bd5ae52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:59.897877 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:25:59.897877 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:25:59.998861 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-bce78115-51eb-4aee-9cc7-62c76bd5ae52 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108064 Apr 05 11:25:59.999506 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Apr 5 11:25:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:26:02.374242 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-65129574-6b57-4889-8ee6-842256e44ac5 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:02.375254 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-65129574-6b57-4889-8ee6-842256e44ac5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Apr 05 11:26:02.376258 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:02.435597 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-1689c27b-3c3b-4b30-b81d-a7f699203f54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 10, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:02.527645 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-1689c27b-3c3b-4b30-b81d-a7f699203f54 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145651 Apr 05 11:26:02.542958 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-a62eff75-b939-4fa7-b714-4cf47846b19c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:02.550083 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:26:02.654839 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-a62eff75-b939-4fa7-b714-4cf47846b19c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115510 Apr 05 11:26:02.659794 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Apr 5 11:26:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:05.028496 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-1689c27b-3c3b-4b30-b81d-a7f699203f54 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:05.029610 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-1689c27b-3c3b-4b30-b81d-a7f699203f54 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Apr 05 11:26:05.030088 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:05.092705 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6e118e1d-a42b-403a-94b5-a6c3e4a7113b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:05.205869 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-6e118e1d-a42b-403a-94b5-a6c3e4a7113b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168824 Apr 05 11:26:05.206559 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:05.220478 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-bc9d9362-d644-49a2-83c4-c8b0ec6d75a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:05.326957 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-bc9d9362-d644-49a2-83c4-c8b0ec6d75a5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108141 Apr 05 11:26:05.326957 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Apr 5 11:26:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:07.731787 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-6e118e1d-a42b-403a-94b5-a6c3e4a7113b admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:07.732814 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-6e118e1d-a42b-403a-94b5-a6c3e4a7113b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Apr 05 11:26:07.733234 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:07.793245 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:07.880302 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140115 Apr 05 11:26:07.881104 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:07.894208 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-7bc75aa9-c5ea-468d-bda5-0261f5ab9e4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:07.980171 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-7bc75aa9-c5ea-468d-bda5-0261f5ab9e4c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090277 Apr 05 11:26:07.980721 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Apr 5 11:26:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:26:10.362413 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:10.363483 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Apr 05 11:26:10.364052 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:10.432914 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-eebb4fe6-e52d-4a66-b839-a13306af08d6 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:10.460066 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-eebb4fe6-e52d-4a66-b839-a13306af08d6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088731 Apr 05 11:26:10.460650 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Apr 5 11:26:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:12.890304 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:12.891779 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-1caf512c-0908-4490-a98e-9b90e0aebaa0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Apr 05 11:26:12.892346 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:12.963037 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-c5241e9c-7bbb-4f9a-bef5-b36fd295558c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:13.041674 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-c5241e9c-7bbb-4f9a-bef5-b36fd295558c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141811 Apr 05 11:26:13.042371 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:13.056429 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-7acc56f9-7dcf-4a7c-abba-3be3007a34b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:13.159327 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-7acc56f9-7dcf-4a7c-abba-3be3007a34b0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107962 Apr 05 11:26:13.159954 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Apr 5 11:26:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:15.615377 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-c5241e9c-7bbb-4f9a-bef5-b36fd295558c admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:15.616546 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-c5241e9c-7bbb-4f9a-bef5-b36fd295558c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Apr 05 11:26:15.617016 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:15.690384 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-bfc791cf-da85-4072-9836-1c97261d298a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "disk": 20}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:15.795011 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-bfc791cf-da85-4072-9836-1c97261d298a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.170813 Apr 05 11:26:15.797509 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:15.808658 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-aea2b2ad-a37d-47db-a931-c2a13702f59d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:15.918187 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-aea2b2ad-a37d-47db-a931-c2a13702f59d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113270 Apr 05 11:26:15.918849 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Apr 5 11:26:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:18.323184 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-bfc791cf-da85-4072-9836-1c97261d298a admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:18.324238 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-bfc791cf-da85-4072-9836-1c97261d298a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 05 11:26:18.324646 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:18.384334 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-0bbe846b-2bdb-4c4f-9a2e-7f2ab1c2c8f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "name": "m1.medium"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:18.445626 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-0bbe846b-2bdb-4c4f-9a2e-7f2ab1c2c8f1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.114652 Apr 05 11:26:18.446183 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:18.458740 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-76328ede-2c20-4563-b254-4d9ed3bffef8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:18.536017 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-76328ede-2c20-4563-b254-4d9ed3bffef8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080912 Apr 05 11:26:18.536532 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Apr 5 11:26:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:26:20.911113 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-0bbe846b-2bdb-4c4f-9a2e-7f2ab1c2c8f1 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:20.912260 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-0bbe846b-2bdb-4c4f-9a2e-7f2ab1c2c8f1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Apr 05 11:26:20.912674 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:20.983007 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-423e1027-d6ce-41a9-8694-512a61e69f5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "vcpus": 4, "id": "4", "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:21.091269 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-423e1027-d6ce-41a9-8694-512a61e69f5e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.170502 Apr 05 11:26:21.092595 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:21.105893 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-aaf7426b-7151-4de1-a36d-f56169ac5d0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:21.230657 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-aaf7426b-7151-4de1-a36d-f56169ac5d0c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128869 Apr 05 11:26:21.231286 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Apr 5 11:26:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:23.756775 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-423e1027-d6ce-41a9-8694-512a61e69f5e admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:23.758452 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-423e1027-d6ce-41a9-8694-512a61e69f5e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Apr 05 11:26:23.759016 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:23.824749 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "disk": 160}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:23.964579 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.199573 Apr 05 11:26:23.968220 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Apr 5 11:26:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:26:23.977107 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4b0cd8bb-6b9f-4bf6-b2cd-a12720bc5b23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:24.095595 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4b0cd8bb-6b9f-4bf6-b2cd-a12720bc5b23 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122026 Apr 05 11:26:24.111696 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Apr 5 11:26:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:48.414320 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:48.415343 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 05 11:26:48.415776 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:48.473423 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-9a9d3384-a560-4048-8dbf-2eb3f23fb2f5 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:48.490277 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-9a9d3384-a560-4048-8dbf-2eb3f23fb2f5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068557 Apr 05 11:26:48.490807 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Apr 5 11:26:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:26:49.862718 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:49.863767 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-df653d45-2ab3-4a30-8472-e02cb7e93fea admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Apr 05 11:26:49.864226 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:50.075787 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-a9f44f34-51b0-4d17-800f-5fb2a58648fb admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:50.083960 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.wsgi [None req-a9f44f34-51b0-4d17-800f-5fb2a58648fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:26:50.084549 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-a9f44f34-51b0-4d17-800f-5fb2a58648fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:50.085373 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-a9f44f34-51b0-4d17-800f-5fb2a58648fb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060660 Apr 05 11:26:50.086208 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Apr 5 11:26:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:26:50.095507 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-943ce2ba-c654-4434-b85f-068f202b1b04 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:50.116080 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-943ce2ba-c654-4434-b85f-068f202b1b04 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024213 Apr 05 11:26:50.116627 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:50.126597 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-c7387e07-2b62-4861-bacb-32d0353b2d35 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:50.147875 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-c7387e07-2b62-4861-bacb-32d0353b2d35 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025243 Apr 05 11:26:50.148418 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:50.157799 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-0cb3617a-4f4f-415b-8b14-b325e458f74e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:50.163192 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-0cb3617a-4f4f-415b-8b14-b325e458f74e admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:26:50.163804 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-0cb3617a-4f4f-415b-8b14-b325e458f74e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:50.164903 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-0cb3617a-4f4f-415b-8b14-b325e458f74e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010641 Apr 05 11:26:50.165396 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Apr 5 11:26:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:26:51.437985 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-c7387e07-2b62-4861-bacb-32d0353b2d35 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:51.439003 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-c7387e07-2b62-4861-bacb-32d0353b2d35 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 05 11:26:51.439407 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:51.637153 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-d8184952-8154-4c7a-8b38-033d3750bc38 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:51.643139 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-d8184952-8154-4c7a-8b38-033d3750bc38 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:26:51.643729 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-d8184952-8154-4c7a-8b38-033d3750bc38 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:51.644521 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-d8184952-8154-4c7a-8b38-033d3750bc38 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061594 Apr 05 11:26:51.645040 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Apr 5 11:26:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:26:51.660234 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-d6549f4f-a7ca-41f7-951c-dc46b884d30f admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:51.674406 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-d6549f4f-a7ca-41f7-951c-dc46b884d30f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021195 Apr 05 11:26:51.674952 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:51.684307 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-a9e035ee-b86f-4061-89f9-2767179c6dd8 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:51.699114 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-a9e035ee-b86f-4061-89f9-2767179c6dd8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018023 Apr 05 11:26:51.699682 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:51.709668 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-dfe5fb94-fe11-487b-94c8-4d395bf39099 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:51.715108 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.wsgi [None req-dfe5fb94-fe11-487b-94c8-4d395bf39099 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:26:51.715715 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-dfe5fb94-fe11-487b-94c8-4d395bf39099 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:51.716492 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-dfe5fb94-fe11-487b-94c8-4d395bf39099 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010409 Apr 05 11:26:51.716986 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Apr 5 11:26:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 05 11:26:53.004966 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-a9e035ee-b86f-4061-89f9-2767179c6dd8 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:53.006088 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-a9e035ee-b86f-4061-89f9-2767179c6dd8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Apr 05 11:26:53.006487 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:53.195180 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-aed67a88-ecb9-436c-943b-a8e37a875bbc admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:53.200448 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.wsgi [None req-aed67a88-ecb9-436c-943b-a8e37a875bbc admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:26:53.201012 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-aed67a88-ecb9-436c-943b-a8e37a875bbc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:53.201800 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-aed67a88-ecb9-436c-943b-a8e37a875bbc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057415 Apr 05 11:26:53.202307 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:26:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:26:53.211745 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-ab32f45a-82a8-464b-897d-9d54ed35c1f9 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:53.225573 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-ab32f45a-82a8-464b-897d-9d54ed35c1f9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017543 Apr 05 11:26:53.226065 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:53.236338 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:53.249800 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018008 Apr 05 11:26:53.250322 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Apr 5 11:26:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:53.259219 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-67c53ce4-8878-4629-8cab-dbb0abd9179a admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:53.264298 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.wsgi [None req-67c53ce4-8878-4629-8cab-dbb0abd9179a admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:26:53.264860 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-67c53ce4-8878-4629-8cab-dbb0abd9179a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:53.265646 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-67c53ce4-8878-4629-8cab-dbb0abd9179a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009935 Apr 05 11:26:53.266162 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:26:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:26:54.547661 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:54.548710 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Apr 05 11:26:54.549175 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:54.740115 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-e8d20def-fe9e-41e1-b9f4-81caea1fa430 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:54.877292 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-e8d20def-fe9e-41e1-b9f4-81caea1fa430 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.188245 Apr 05 11:26:54.877847 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Apr 5 11:26:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:56.142377 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:56.143793 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Apr 05 11:26:56.144224 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:56.338378 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-876de5ac-5f2e-4a06-9577-e9d5a345136f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:56.426907 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-876de5ac-5f2e-4a06-9577-e9d5a345136f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.139825 Apr 05 11:26:56.427394 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Apr 5 11:26:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:26:57.695095 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:57.696147 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 05 11:26:57.696547 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:57.888542 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-60fe997f-173d-4dcd-8889-180070a5228a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:57.987247 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-60fe997f-173d-4dcd-8889-180070a5228a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.150587 Apr 05 11:26:57.987760 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Apr 5 11:26:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:26:59.252151 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:59.253207 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 05 11:26:59.253628 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:59.443494 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-b4f59abe-ecbf-4ef7-90a3-7bd80e25e523 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:59.529067 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-b4f59abe-ecbf-4ef7-90a3-7bd80e25e523 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.137112 Apr 05 11:26:59.529648 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Apr 5 11:26:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:27:00.834132 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:00.835141 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Apr 05 11:27:00.835836 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:27:01.032929 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-83fe8219-b59a-4ec4-aef9-5764a049018d admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:01.052301 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-83fe8219-b59a-4ec4-aef9-5764a049018d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070437 Apr 05 11:27:01.052770 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Apr 5 11:27:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:27:55.913368 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:55.914384 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4d233dbe-1d54-4584-93de-c7ff8fa65427 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 05 11:27:55.914786 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Tue Apr 5 11:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:27:55.972006 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-d1c89363-19da-460c-9b53-eda127a4033e admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:55.990948 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-d1c89363-19da-460c-9b53-eda127a4033e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069612 Apr 05 11:27:55.991449 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Apr 5 11:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:27:56.014388 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-4550ddd5-84c9-41b6-9550-887f8211bfd1 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:56.021998 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-4550ddd5-84c9-41b6-9550-887f8211bfd1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012979 Apr 05 11:27:56.022514 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Tue Apr 5 11:27:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:27:56.034603 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-2060c677-a802-40a9-a476-403f62f33044 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:56.042061 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-2060c677-a802-40a9-a476-403f62f33044 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011036 Apr 05 11:27:56.042573 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Tue Apr 5 11:27:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:56.060053 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-c8a26aca-b41b-4e8e-970a-9875b1c1bc9c admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:56.069664 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-c8a26aca-b41b-4e8e-970a-9875b1c1bc9c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017152 Apr 05 11:27:56.070196 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Tue Apr 5 11:27:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:56.082013 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:56.089746 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011288 Apr 05 11:27:56.090304 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Tue Apr 5 11:27:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:49.138684 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-20754683-ff8d-4f5b-8779-63afeed7de45 tempest-verify_tempest_config-429475908 tempest-verify_tempest_config-429475908-project] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:49.148130 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-20754683-ff8d-4f5b-8779-63afeed7de45 tempest-verify_tempest_config-429475908 tempest-verify_tempest_config-429475908-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105531 Apr 05 11:29:49.148130 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Apr 5 11:29:49 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:31:36.101811 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:36.102826 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 05 11:31:36.103224 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:31:36.358979 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:36.360211 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:31:36.360211 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:31:36.361395 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:36.361832 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:36.362615 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:36.363066 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:36.396181 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-3ebd6934-de2c-4603-9cad-b3fc2439b77c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147930 Apr 05 11:31:36.396737 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 35/71] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:31:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:31:37.677135 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:37.678132 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Apr 05 11:31:37.678526 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:37.873495 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:37.874685 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:31:37.874685 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:31:37.875896 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:37.876343 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:37.877150 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:37.877575 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:37.896583 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-85f7b4c7-0fb1-41ad-83fa-2a27f2b3b605 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076661 Apr 05 11:31:37.897080 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:31:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:31:49.603340 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:49.604893 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Apr 05 11:31:49.605286 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:49.797287 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:49.798460 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:31:49.798460 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:31:49.799704 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:49.800142 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:49.800933 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:49.801416 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:49.828524 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-26ff6ce2-3d28-4b5a-b0cb-ec437cc6a41a admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084123 Apr 05 11:31:49.829029 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 37/75] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:31:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:31:51.143721 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: DEBUG nova.api.openstack.wsgi [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] Calling method '>' {{(pid=103204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:51.144731 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: INFO nova.api.openstack.requestlog [None req-4400401e-f814-451b-8d1c-e1a843c16702 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Apr 05 11:31:51.145131 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: [pid: 103204|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Apr 5 11:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:51.338471 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG nova.api.openstack.wsgi [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] Calling method '>' {{(pid=103203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:51.339825 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:31:51.339825 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: warnings.warn(msg) Apr 05 11:31:51.341062 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:51.341506 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:51.342300 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:51.342733 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: DEBUG oslo_concurrency.lockutils [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:51.364545 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: INFO nova.api.openstack.requestlog [None req-7b39a6e1-a1f6-4261-8c26-3cc9152801a3 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078196 Apr 05 11:31:51.365058 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: [pid: 103203|app: 0|req: 38/77] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Apr 5 11:31:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:32:51.896570 dv-cinder-834448-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 05 11:32:51.897089 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: Tue Apr 5 11:32:51 2022 - graceful shutdown triggered... Apr 05 11:32:51.897529 dv-cinder-834448-3-iscsi devstack@n-api.service[103204]: Gracefully killing worker 2 (pid: 103204)... Apr 05 11:32:51.897986 dv-cinder-834448-3-iscsi devstack@n-api.service[103203]: Gracefully killing worker 1 (pid: 103203)... Apr 05 11:32:52.897996 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: worker 1 buried after 1 seconds Apr 05 11:32:52.898471 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: worker 2 buried after 1 seconds Apr 05 11:32:52.898471 dv-cinder-834448-3-iscsi devstack@n-api.service[103202]: goodbye to uWSGI. Apr 05 11:32:52.899636 dv-cinder-834448-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 05 11:32:52.900193 dv-cinder-834448-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 05 11:32:52.903543 dv-cinder-834448-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:32:52.919922 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:32:52 2022] *** Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: nodename: dv-cinder-834448-3-iscsi Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: machine: x86_64 Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: clock source: unix Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: pcre jit disabled Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: detected number of CPU cores: 4 Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: current working directory: / Apr 05 11:32:52.943242 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: your processes number limit is 47680 Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: your memory page size is 4096 bytes Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: detected max file descriptor number: 2048 Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: lock engine: pthread robust mutexes Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: thunder lock: enabled Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:32:52.944072 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:32:53.000118 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: Python main interpreter initialized at 0x55f7262aa9c0 Apr 05 11:32:53.000118 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: python threads support enabled Apr 05 11:32:53.000118 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: your server socket listen backlog is limited to 100 connections Apr 05 11:32:53.000118 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:32:53.000550 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:32:53.000645 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: *** Operational MODE: preforking *** Apr 05 11:32:53.000852 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:32:53.000852 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: spawned uWSGI master process (pid: 124226) Apr 05 11:32:53.001065 dv-cinder-834448-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:32:53.001764 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: spawned uWSGI worker 1 (pid: 124242, cores: 1) Apr 05 11:32:53.002553 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: spawned uWSGI worker 2 (pid: 124243, cores: 1) Apr 05 11:32:53.002553 dv-cinder-834448-3-iscsi devstack@n-api.service[124226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:32:54.396401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:32:54.437762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:32:55.340181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:32:55.340181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: from cryptography.utils import int_from_bytes Apr 05 11:32:55.340517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:32:55.340517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: from cryptography.utils import int_from_bytes Apr 05 11:32:55.377021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:32:55.377021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: from cryptography.utils import int_from_bytes Apr 05 11:32:55.377365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:32:55.377365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: from cryptography.utils import int_from_bytes Apr 05 11:32:57.756896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:32:57.757469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:32:57.757769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:32:57.758078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:32:57.758341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:32:57.758741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.759073 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.759393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.760510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.760952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.761279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.761615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.761948 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.762288 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.762561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.762892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.763230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834448-3-iscsi {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.763588 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.763910 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.764745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.764745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.764923 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.765192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.765504 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.766016 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.767600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.767600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.767600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.768015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.768277 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.768595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.768933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.769244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.769580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.769896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.770314 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834448-3-iscsi {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.770640 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.770960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.771294 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.771737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.772059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.772376 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.772703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.773036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.773354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.773690 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.774020 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.774350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.774685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.774994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.775313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.776253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.776585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.776900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.777215 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.777476 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.777795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.778129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.778461 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.778796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.779062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.779323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.779677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.780005 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.780323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.780651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.780960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.781283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.781593 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.781907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.782238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.782550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.782889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.783210 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.783572 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.783893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.784226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.784639 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.784899 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.785217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.785566 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.785896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.786216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.786550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.786880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.787199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.787539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.787858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.788188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.788539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.788855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.789118 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.789433 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.789749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.790081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.790845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.790845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.792551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.794966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.795986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.795986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.795986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.797493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.797493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.797493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.797493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.797493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.802302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.803528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.804880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.805329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.805329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.805648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.806008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.806331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.807076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.807692 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.807793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.808060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.808392 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.808734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.809060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.809387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.810205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.810205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.810340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.810672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.811003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.811331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.811687 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.812010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.812337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.812679 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.813022 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.813348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.813701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.814064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.814390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.814728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.815064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.815386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.815731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.816053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.816387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.816729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.817050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.817378 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.817698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.818106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.818428 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.818749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.819265 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.819652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.820032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.820357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:32:57.820813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.820894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:32:57.820980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.821150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.821273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:32:57.821808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:32:57.822004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.822114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:32:57.822886 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.823115 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.823377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.823496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.823582 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.823802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.823900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.824144 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.824253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.825058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.825226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.825379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.825523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.825617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.825700 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.825791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.825875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.825962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.826054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.826054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.826203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.826297 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.826387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.826623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834448-3-iscsi {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.826736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.826948 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.827054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.827262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.827351 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.827618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.827737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.827943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.828045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.828263 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.828361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.828597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.828676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.828949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.829273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.829587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.829724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.829920 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.830236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.830323 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.830565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.830652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.830919 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.831013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.831185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.831293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.831531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.831636 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.831887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.831983 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.832162 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.832254 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.832491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.832608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.832814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.833135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.833413 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.833541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.833873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.833977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.834059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.834132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.834437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.834539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834448-3-iscsi {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.834767 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.835283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.835378 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.835516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.835617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.835695 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.835873 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.836010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.836196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.836479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.836602 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.836801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.836907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.837117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.837223 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.837438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.837538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.837755 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.837866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.838726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.838851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.839046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.839126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.839364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.839483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.839710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.839829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.840026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.840123 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.840348 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.840438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.840662 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.840765 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.840979 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.841133 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.841290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.841392 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.841581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.841697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.842010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.842134 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.842232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.842322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.842512 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.842612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.842847 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.842952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.843108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.843245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.843350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.843596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.843711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.843925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.844040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.844246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.844359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.844907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.845024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.845110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.845191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.845271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.845367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.845504 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.845595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.845824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.845927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.846156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.846349 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.846474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.846609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.846913 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.847126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.847214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.847385 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.847510 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.847742 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.847835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.848059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.848159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.848387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.848479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.848722 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.848819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.849038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.849129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.849382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.849473 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.849708 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.849798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.850025 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.850125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.850345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.850436 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.850665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.850763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.850979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.851070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.851295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.851385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.851644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.851769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.851970 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.852081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.852289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.852393 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.852612 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.852713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.852874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.852996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.853182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.853273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.853558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.853705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.853930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.854013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.854246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.854344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.854562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.854667 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.854875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.854986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.855188 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.855326 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.855527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.855672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.855843 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.855994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.856158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.856325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.856472 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.856645 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.856784 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.857031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.857184 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.857276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.857398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.857585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.857711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.858008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.858157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.858283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.858381 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.858523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.858652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.858844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.858949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.859165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.859271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.859505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.859621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.859832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.859941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.860152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.860250 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.860464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.860562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.860775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.860867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.861092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.861182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.861414 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.861514 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.861743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.861846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.862058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.862230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.862391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.862506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.862704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.862811 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.863015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.863119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.863324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.863449 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.863677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.863785 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.863988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.864093 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.864300 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.864405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.864611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.864786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.864934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.865084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.865272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.865434 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.865578 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.865717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.865857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.866009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.866187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.866343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.866520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.866671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.866821 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.866972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.867150 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.867292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.867501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.867738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.867893 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.868079 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.868248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.868398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.868539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.868691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.868840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:32:57.868982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.869157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.869717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.869880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870314 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870622 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.870912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871698 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.871986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872379 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.872955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873250 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873568 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.873886 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874180 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874472 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874612 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.874908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875531 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875683 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875824 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.875963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876269 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.876997 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877445 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877755 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.877984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.878885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879471 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879581 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.879896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880118 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.880839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881068 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881159 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.881860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882170 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882496 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882822 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.882977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.883267 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.883442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.883611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.883762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.883917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.884065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.884212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.884378 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.884527 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.884682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.886129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.886383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.886544 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.886704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.886864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.887015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.887174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.888234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.888234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.888575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.888742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.888901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.889059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.889208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.889355 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.889512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.889807 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.890206 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.890366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.890523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.890687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.890844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.891012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.891177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.891335 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.891523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.891686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.892726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.892901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.893699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894462 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.894904 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895712 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.895874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.896042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.896204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.896368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.896526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.897315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.897478 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.897642 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.897799 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.897956 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898281 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898510 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.898993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.899148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.899298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.899484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.899830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.899982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.900129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.900286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.901717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902829 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.902977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903817 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.903967 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904418 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.904877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905415 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.905886 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.906962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.907925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.908208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.908355 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.908520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.908743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.908907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909056 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909203 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909818 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.909968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910123 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910424 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.910879 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.911999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912771 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.912919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913075 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913536 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913696 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.913997 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914614 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.914925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915569 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.915876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.916097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.916706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.916866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917169 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917632 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.917946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918584 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918752 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.918984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919296 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.919962 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920275 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920439 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.920891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921183 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921494 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921679 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.921988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.922300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.922300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.922597 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.922743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.922896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923209 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923364 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.923863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924341 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924489 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.924960 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925556 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.925867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926326 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926637 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.926939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927725 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.927872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.928837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929544 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929700 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.929857 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.930951 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.931100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.931255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.931439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.931620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.931930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.932460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.932621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.932793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.932951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933109 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933411 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.933876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.934968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.935124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.935273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.935525 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.935691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.935848 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936162 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936657 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.936981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937138 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937305 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937766 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.937921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938842 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.938989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.939143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.939380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.939555 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.939704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.939863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.940013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.940175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.940325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.940694 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.940853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941822 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.941978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942127 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942441 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.942905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943223 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943630 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.943996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944614 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944804 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.944971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945151 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945332 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945332 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945727 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.945980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946086 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.946963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.947058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.947143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.947796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.947885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.947979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948108 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948233 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948868 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.948947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949804 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.949976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950056 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950374 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950629 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950709 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950878 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.950960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951684 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951776 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.951942 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952101 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952279 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952814 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952894 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.952982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.953073 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.953868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.953979 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954583 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954674 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.954938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.955109 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.955205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.955506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.955695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.955808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.956783 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957019 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957441 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957658 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.957972 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.958913 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.959992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.960958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.961891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.962900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.963774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.963872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964509 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.964836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.965973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966136 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966298 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966462 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.966941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.967920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.968907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.969171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.969337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.969504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.969661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.969817 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970435 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970678 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.970770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.971782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972423 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.972955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973267 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.973947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974404 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974518 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.974940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.975148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.975378 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.975506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.975789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.975889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976106 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976196 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976788 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.976886 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977115 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.977867 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978811 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.978903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979136 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979566 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979788 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.979881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980109 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980210 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980430 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.980835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.981810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982341 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.982961 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.983942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984306 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984572 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984852 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.984964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.985165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.985389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.985483 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.985711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.985809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986131 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986698 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.986796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987347 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987690 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.987794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988434 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.988982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989392 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.989941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.990938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.991166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.991324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.991532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.991687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.991876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992048 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992520 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.992994 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.993170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.993308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.993492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.993627 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.993812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994593 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.994996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995320 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995667 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.995990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.996952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.997930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.998912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999385 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:57.999914 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000693 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.000896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.001883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002421 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002545 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.002890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003392 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.003905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004162 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.004854 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.005832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006067 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.006807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007068 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.007992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008407 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.008932 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.009031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.009246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.009345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.009555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.009647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.010430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.010547 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.010745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.010923 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.011985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012507 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.012916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013571 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013777 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.013877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014207 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.014810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015131 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015347 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015453 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015700 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.015790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016025 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016127 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016684 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016897 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.016998 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017569 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.017999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018870 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.018962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.019963 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020184 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020277 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020506 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020826 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.020926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.021897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.022860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023773 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.023876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.024902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.025061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.025153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.025449 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026040 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026285 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.026934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027516 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.027958 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028194 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028294 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.028993 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029314 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029634 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.029971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.030203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.030397 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.030526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.030722 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.030843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.031065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.031156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:32:58.031403 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.031763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.032090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.032416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.032757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.033072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.033388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.033711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.034032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.034346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.034681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.035002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.035314 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.035669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.035992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.036535 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.036893 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.037220 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.037556 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.037894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.038224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.038541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.038876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.039194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.039534 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.039861 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.040181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.040495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.040807 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.041265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.041721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.042040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.042361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.042676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.043014 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.043330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.043671 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.043988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.044307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.044633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.044950 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.045250 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.045563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.045883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.046197 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.046516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.046830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.047151 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.047493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.047816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.048192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.048533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.048853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.049558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.050177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.050528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.050856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.051181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.051541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.051894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.052225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.052802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.053149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.053482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.053832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.054033 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.054211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.054507 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.054825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.055139 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.055501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.055828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.056171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.056470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.057328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.058042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.058204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.058527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.058853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.059174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.059521 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.059845 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.060168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.060507 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.060863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.061212 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.061520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.061850 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.062177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.062500 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.062910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.063138 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.063476 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.063807 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.064146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.064469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.064802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.065223 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.065543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.065871 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.066200 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.066520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.066853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.067186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.067527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.067860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.068182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.068524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.068876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.069215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.069552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.069868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.070182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.070494 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.070813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.071141 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.071739 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.072054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.072910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.073229 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.073543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.073858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.074172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.074486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.074803 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.075116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.075454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.075767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.076078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.076393 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.076703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.077018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.077330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.077643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.077951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.078263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.078579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.078920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.079265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.079613 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.079946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.080263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.080594 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.080911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.081246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.081575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.081900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.082234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.082559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.082875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.083195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.083537 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.083858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.084180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.084496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.084835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.085173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.085491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.085828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.086153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.086481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.086805 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.087139 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.087505 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.087841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.088172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.088498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.088822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.089140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.089465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.089789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.090125 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.090460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.090794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.091130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.091509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.091836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.092190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.092530 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.092856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.093179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.093494 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:32:58.093744 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:32:58.116544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_db.sqlalchemy.engines [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.120822 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.context [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd(cell1) {{(pid=124242) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:32:58.125239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:32:58.126846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:32:58.127697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:32:58.129648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:32:58.141287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.142179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.180774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.context [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd(cell1) {{(pid=124243) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:32:58.185717 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:32:58.187330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:32:58.188183 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:32:58.190137 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:32:58.201923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_db.sqlalchemy.engines [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.203255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_db.sqlalchemy.engines [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.299278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.362512 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_db.sqlalchemy.engines [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:32:58.740770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:32:58.747928 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:32:58.804087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: WARNING keystonemiddleware.auth_token [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:32:58.811284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: WARNING keystonemiddleware.auth_token [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:32:58.982635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:32:58.987949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-31342007-929b-421f-9eca-4c9d6211b578 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:32:58.993301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f7262aa9c0 pid: 124242 (default app) Apr 05 11:32:59.044034 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: WARNING keystonemiddleware.auth_token [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:32:59.049180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: WARNING keystonemiddleware.auth_token [None req-e5cc57ab-7bb1-42cc-8c10-40b735baeec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:32:59.054502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7262aa9c0 pid: 124243 (default app) Apr 05 11:33:46.072094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-224406727", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "networks": [{"uuid": "f9525c86-10c8-497e-a632-56ef24ce13c6"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:33:46.555610 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] validate_networks() for [('f9525c86-10c8-497e-a632-56ef24ce13c6', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:33:46.981209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c825b1f0-567b-4fb3-a97e-c90360bca771 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f1388c43940>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:47.500387 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c825b1f0-567b-4fb3-a97e-c90360bca771 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/044de699-b8d6-4feb-8fc4-02e48bbb5f98" status: 200 len: 350 microversion: 2.1 time: 0.848679 Apr 05 11:33:47.501466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:33:46 2022] GET /compute/v2.1/os-volumes/044de699-b8d6-4feb-8fc4-02e48bbb5f98 => generated 350 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:49.279622 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:33:49.280787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:33:49.282099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:33:49.282805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:33:49.283459 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:33:49.314198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:49.323763 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:49.329977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:49.331673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:49.402957 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Getting quotas for project 6f6424cbfe534f7bb64b4e6653d31a06. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:33:49.415369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Getting quotas for user 5d2373fbe8344eec8a0601c9eb34c45c and project 6f6424cbfe534f7bb64b4e6653d31a06. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:33:49.434616 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:33:49.438229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:33:49.761060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6bdb961-ed84-4e91-9e42-3091536e67d4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.146862 Apr 05 11:33:49.762049 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:33:49.774017 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-db80d29c-e6e2-479d-a3a2-a6eeea0e38c9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:49.774791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-db80d29c-e6e2-479d-a3a2-a6eeea0e38c9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:49.959111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de325cc5-6af3-467a-9625-b800046a34c5 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f13881911f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:50.094437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de325cc5-6af3-467a-9625-b800046a34c5 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d862130f-452e-42a4-99fe-915890dc4575" status: 200 len: 351 microversion: 2.1 time: 0.154806 Apr 05 11:33:50.096037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:33:49 2022] GET /compute/v2.1/os-volumes/d862130f-452e-42a4-99fe-915890dc4575 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:50.417926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-db80d29c-e6e2-479d-a3a2-a6eeea0e38c9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:50.471105 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-db80d29c-e6e2-479d-a3a2-a6eeea0e38c9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1214 microversion: 2.1 time: 0.702513 Apr 05 11:33:50.490617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:49 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1214 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:51.491471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e69afa00-6bf8-45cd-bb47-367ca3b6fcc0 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:51.495444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e69afa00-6bf8-45cd-bb47-367ca3b6fcc0 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:51.768845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e69afa00-6bf8-45cd-bb47-367ca3b6fcc0 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:51.807346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e69afa00-6bf8-45cd-bb47-367ca3b6fcc0 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1214 microversion: 2.1 time: 0.314904 Apr 05 11:33:51.818898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:51 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:52.351660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-baf67f67-901b-4956-990e-bc94f367a11c tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f13880fea60>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:52.439394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-baf67f67-901b-4956-990e-bc94f367a11c tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7e0b41-4926-4b75-9c67-e1be325610c5" status: 200 len: 350 microversion: 2.1 time: 0.098455 Apr 05 11:33:52.440188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 4/6] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:33:52 2022] GET /compute/v2.1/os-volumes/dc7e0b41-4926-4b75-9c67-e1be325610c5 => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:52.453309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-da7e8f3b-5b9e-4f9b-8540-074408cbaa77 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f1388127790>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:52.591544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: .version_select at 0x7f13889f9820>, body: {"keypair": {"name": "tempest-keypair-1724679694"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:33:52.633529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-da7e8f3b-5b9e-4f9b-8540-074408cbaa77 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.183636 Apr 05 11:33:52.634517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 5/7] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Apr 5 11:33:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:33:52.647395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c2401705-60d5-4f22-9c5c-6f4ad2ebf3a2 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f13880b71f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:52.785823 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:33:52.807457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:33:52.924538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c2401705-60d5-4f22-9c5c-6f4ad2ebf3a2 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.281231 Apr 05 11:33:52.925116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 6/8] 10.222.0.60 () {58 vars in 1148 bytes} [Tue Apr 5 11:33:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:33:52.931009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:52.932854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:52.960893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:52.960893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:52.960893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:52.960893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:53.311088 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:53.326258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b653ff9c-742c-43be-a0fe-d1382e04c0b4 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1218 microversion: 2.1 time: 0.400079 Apr 05 11:33:53.336251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 7/9] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:52 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1218 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:53.336251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef9e8092-dca2-4221-87a3-19b449237b0e tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f138809fc10>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:53.536123 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef9e8092-dca2-4221-87a3-19b449237b0e tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.207718 Apr 05 11:33:53.536935 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 8/10] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Apr 5 11:33:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:53.548925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f525dda-b89e-4abd-a9ba-f88f4ebfd24b tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f13880ae700>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:53.644746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f525dda-b89e-4abd-a9ba-f88f4ebfd24b tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100138 Apr 05 11:33:53.653372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 9/11] 10.222.0.60 () {58 vars in 1166 bytes} [Tue Apr 5 11:33:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:53.659847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c557849e-0f5e-4f16-9eaa-777df64217d8 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f13880ae0d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:53.761556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c557849e-0f5e-4f16-9eaa-777df64217d8 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106524 Apr 05 11:33:53.762458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 10/12] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Apr 5 11:33:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:53.776540 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a55ed5c1-1830-467a-a780-1de0677f6a2d tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f1388127790>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:53.904877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a55ed5c1-1830-467a-a780-1de0677f6a2d tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.134007 Apr 05 11:33:53.906332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 11/13] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Apr 5 11:33:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:53.923198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f033c974-831a-45ba-96a7-7532b5073de1 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f138804be50>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:54.039089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:33:54.046375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:33:54.081615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d0205fb-929e-450c-a2e8-b57aa09fc8c9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.049562 Apr 05 11:33:54.083710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 3/14] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:33:52 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:33:54.098684 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f033c974-831a-45ba-96a7-7532b5073de1 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183856 Apr 05 11:33:54.099321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 12/15] 10.222.0.60 () {58 vars in 1187 bytes} [Tue Apr 5 11:33:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:33:54.111351 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4a502b7e-02cd-4583-a5de-4c9d6a100234 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] Calling method '.version_select at 0x7f1388984700>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:54.253315 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4a502b7e-02cd-4583-a5de-4c9d6a100234 tempest-VolumesTestJSON-350699294 tempest-VolumesTestJSON-350699294-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.145704 Apr 05 11:33:54.253883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 4/16] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Apr 5 11:33:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:54.345881 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:54.346547 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:54.359198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:54.359688 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:54.368257 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:54.368955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:54.556296 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:54.565301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7946faa9-c1d8-4de8-a491-4ee8350e0c36 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1266 microversion: 2.1 time: 0.225744 Apr 05 11:33:54.590836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 13/17] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:54 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:55.612496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:55.614240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:55.634844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:55.635632 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:55.638769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:55.639242 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:56.072998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:56.095337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-95102d54-1709-414c-aa2a-cb9f212b8756 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1272 microversion: 2.1 time: 0.486776 Apr 05 11:33:56.095989 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 5/18] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:55 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1272 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:57.113608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:57.115010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:57.131787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:57.133862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:57.137974 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:57.141216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:57.314006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:33:57.322348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6cffadf2-89c7-4b34-aabe-0373884cfd44 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1272 microversion: 2.1 time: 0.212787 Apr 05 11:33:57.335054 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 14/19] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:57 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:33:58.342409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:33:58.353829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:33:58.353829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:58.354227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:33:58.357786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:33:58.360330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:00.166746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:00.178575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cfa0d50d-6231-45d5-bba6-6b605bfa2d0a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 1.840095 Apr 05 11:34:00.199487 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 6/20] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:33:58 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:01.199118 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:01.199791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:01.217203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:01.217731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:01.224458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:01.224954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:02.465888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-261949969", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cbffa01-3137-49e9-97ed-1f17fab5a300"}], "security_groups": [{"name": "tempest-securitygroup--502868268"}], "key_name": "tempest-keypair-1724679694", "user_data": "}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:03.058088 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:03.074673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-662be212-e2f6-408f-bb99-84cd3627e1a9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 1.881085 Apr 05 11:34:03.087037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 15/21] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:01 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:03.143899 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.network.neutron [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] validate_networks() for [('8cbffa01-3137-49e9-97ed-1f17fab5a300', None, None, None, None, None)] {{(pid=124243) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:34:03.392481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: .version_select at 0x7f13880421f0>, body: {"keypair": {"name": "tempest-keypair-644398058"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:03.450761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:03.465988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:04.046252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:04.067274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:04.116114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb46d680-e569-44e0-bde5-338e9b4cfedd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.027451 Apr 05 11:34:04.118097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 16/22] 10.222.0.60 () {62 vars in 1198 bytes} [Tue Apr 5 11:34:03 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:34:04.125735 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:04.130489 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:04.150687 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:04.151698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:04.156356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:04.157001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:05.318518 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Flavor limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:34:05.319268 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Image limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:34:05.319941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Flavor pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:34:05.320411 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Image pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:34:05.320912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:34:05.345501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:05.345501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:05.345501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:05.345501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:05.394641 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:05.413535 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:05.456074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Going to run 1 instances... {{(pid=124243) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:34:05.460773 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:34:05.760028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-528e0e29-f65f-447a-a4cf-d0681c6a6ecd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.302214 Apr 05 11:34:05.761063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 7/23] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:34:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:34:05.781451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-85395a48-fa0f-4a52-9f67-f61dd6e415e0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:05.791158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-85395a48-fa0f-4a52-9f67-f61dd6e415e0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:06.046308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-85395a48-fa0f-4a52-9f67-f61dd6e415e0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:06.060640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-85395a48-fa0f-4a52-9f67-f61dd6e415e0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1237 microversion: 2.1 time: 0.289766 Apr 05 11:34:06.068744 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 8/24] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:05 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1237 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:06.416684 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:06.443553 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd8b1c9e-b1b9-4272-95f2-95dbe96a1188 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 2.323975 Apr 05 11:34:06.447750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 17/25] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:04 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:07.087117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ca70c77e-5ed0-4488-b0ab-95d6dc42d8ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:07.088041 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ca70c77e-5ed0-4488-b0ab-95d6dc42d8ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:07.271753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ca70c77e-5ed0-4488-b0ab-95d6dc42d8ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:07.298170 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ca70c77e-5ed0-4488-b0ab-95d6dc42d8ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1237 microversion: 2.1 time: 0.214896 Apr 05 11:34:07.320269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 9/26] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:07 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1237 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:07.464494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:07.465156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:07.474555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:07.476734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:07.477807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:07.483896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:08.326005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-642cde4c-fb22-4e75-b7cd-c788be7dcc8e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:08.335637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-642cde4c-fb22-4e75-b7cd-c788be7dcc8e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:08.778028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-642cde4c-fb22-4e75-b7cd-c788be7dcc8e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:08.791758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-642cde4c-fb22-4e75-b7cd-c788be7dcc8e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1237 microversion: 2.1 time: 0.466687 Apr 05 11:34:08.792394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 10/27] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:08 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1237 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:08.929973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-482aa158-5eb6-4738-ab0c-f333ca79c499 req-a5f3c94b-d72d-4fad-b4d5-c12f33f5990c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa16bad4-76dd-4c1b-860c-26cc38b192ef", "tag": "cef96bf1-0c42-42f7-a9fa-681679365ad3"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:08.955674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-482aa158-5eb6-4738-ab0c-f333ca79c499 req-a5f3c94b-d72d-4fad-b4d5-c12f33f5990c service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:08.956139 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-482aa158-5eb6-4738-ab0c-f333ca79c499 req-a5f3c94b-d72d-4fad-b4d5-c12f33f5990c service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:09.212159 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:09.227636 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4365219-e7d0-48b2-8219-ceeb052e2612 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 1.767701 Apr 05 11:34:09.238776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 18/28] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:07 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:09.347829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-482aa158-5eb6-4738-ab0c-f333ca79c499 req-a5f3c94b-d72d-4fad-b4d5-c12f33f5990c service nova] Creating event network-changed:cef96bf1-0c42-42f7-a9fa-681679365ad3 for instance fa16bad4-76dd-4c1b-860c-26cc38b192ef on hv-cinder-83444 Apr 05 11:34:09.352322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-482aa158-5eb6-4738-ab0c-f333ca79c499 req-a5f3c94b-d72d-4fad-b4d5-c12f33f5990c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:34:09.355826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:09.357042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:09.358657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:09.359361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:09.383219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.compute.rpcapi [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:34:09.384570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] Releasing lock "compute-rpcapi-router" {{(pid=124243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:34:09.432385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-01e2e5f4-8004-451a-8af3-3aecd2bc51bd None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625116 Apr 05 11:34:09.433679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 11/29] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:09.828173 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:09.828867 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:09.852886 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:09.855329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:09.859498 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:09.860039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:10.078276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:10.091990 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7df57269-317e-44a9-baca-381f448241ec tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1233 microversion: 2.1 time: 0.269021 Apr 05 11:34:10.099581 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 19/30] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:09 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1233 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:10.250976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:10.253024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:10.264742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:10.264973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:10.279944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:10.282019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:10.570298 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:10.580659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5e9769f6-847f-4252-a3d3-c9e09e16c77a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.335798 Apr 05 11:34:10.581468 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 12/31] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:10 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:11.109296 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-212479988", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e75e15ad-ea96-4c51-a99a-e2b235a6dca2"}], "security_groups": [{"name": "tempest-securitygroup--278274267"}], "key_name": "tempest-keypair-644398058", "user_data": "}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:11.581472 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.network.neutron [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] validate_networks() for [('e75e15ad-ea96-4c51-a99a-e2b235a6dca2', None, None, None, None, None)] {{(pid=124243) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:34:11.865541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: .version_select at 0x7f13837e3f70>, body: {"keypair": {"name": "tempest-keypair-611072145"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:11.956026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:11.995971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:12.658060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Flavor limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:34:12.659591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Image limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:34:12.660367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Flavor pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:34:12.661096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Image pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:34:12.661810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:34:12.686608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:12.687408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:12.688620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:12.689333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:12.732601 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:12.840952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:12.840952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Going to run 1 instances... {{(pid=124243) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:34:12.840952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:34:13.763536 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:13.776100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:13.810564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c03b6b4-ce53-466f-ade8-7fcaee4c6c58 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.769948 Apr 05 11:34:13.811837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 20/32] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:34:11 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:13.822175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:13.823458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:13.831684 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:13.833335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:13.836776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:13.838059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:14.053070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:14.053070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7e6e4dc8-5fd3-4585-aa7b-19fd443ac7d2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1295 microversion: 2.1 time: 0.234171 Apr 05 11:34:14.058842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 21/33] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:13 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1295 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:14.065789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:14.066657 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:14.075745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:14.076526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:14.077540 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:14.078124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:14.284108 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:14.292232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e30fe671-e499-47fa-b4d0-2c1719fcd998 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.187656 Apr 05 11:34:14.293455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3be1a62e-6902-4506-babd-cb9ada1dfe39 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.233228 Apr 05 11:34:14.298642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 13/34] 10.222.0.60 () {62 vars in 1187 bytes} [Tue Apr 5 11:34:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 3195 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 11:34:14.307557 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 22/35] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:14 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:14.312625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:14.313252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:14.424089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:14.433415 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:14.442113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:14.453091 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40d44d01-1797-4290-96bb-469f1aaae6ca tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1280 microversion: 2.20 time: 0.144246 Apr 05 11:34:14.471556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 23/36] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:14 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:14.758654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1064855825", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:14.913482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.network.neutron [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] validate_networks() for [('912aa55e-5878-42db-a34a-a968382fba80', None, None, None, None, None)] {{(pid=124243) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:34:15.065719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:15.071702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:15.080967 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:15.082614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:15.085112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:15.086492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:15.691951 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:15.704914 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-927ac272-d8a1-45f8-b70c-622eeac67772 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.640461 Apr 05 11:34:15.707711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 24/37] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:15 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:15.720777 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:15.721872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:15.736546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:15.738220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:15.740307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:15.741673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.442573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:16.478884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eeb6f9e4-7a61-4d7c-a6c9-97cc3b5306c2 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.769791 Apr 05 11:34:16.479855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 25/38] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:15 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:16.506025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:16.507936 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:16.516507 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.517543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.518718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.519965 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.633053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:16.661583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:16.674321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:16.676576 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ca2f7ef-12a7-4571-aa87-20953a4fe999 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1284 microversion: 2.20 time: 0.190135 Apr 05 11:34:16.677715 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 26/39] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:16 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:16.724563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:16.725819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:16.739113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.744023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.744820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.745280 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.842701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:34:16.844051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:34:16.844721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:34:16.845325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:34:16.846049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:34:16.860021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.860992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.862902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:16.863743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:16.920152 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:16.933386 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for user 3185ec21337a4154b650b30b89519716 and project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:16.979448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Going to run 1 instances... {{(pid=124243) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:34:16.983968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:34:17.117686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:17.127344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31aa41ea-9a72-4110-8f0d-9f423bdad3d4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.406790 Apr 05 11:34:17.130992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 27/40] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:16 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:17.185218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f1d5dead-509a-437b-954d-3c614763ed49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.884919 Apr 05 11:34:17.197595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44ead672-de51-4d2d-b635-b47429de7f1b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:17.198405 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44ead672-de51-4d2d-b635-b47429de7f1b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:17.202038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 14/41] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:34:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:34:17.498870 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:17.499543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:17.511859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:17.512389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:17.513240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:17.513693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:17.783072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44ead672-de51-4d2d-b635-b47429de7f1b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:17.798910 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44ead672-de51-4d2d-b635-b47429de7f1b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1222 microversion: 2.1 time: 0.601732 Apr 05 11:34:17.813676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 28/42] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:17 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1222 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:17.860984 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:17.864149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:17.895200 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:17.902075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:17.907781 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:17.911954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:18.138657 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:18.148782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:18.157633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:18.159108 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c703d73-fe73-4acc-bc20-82dfe82a441a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1332 microversion: 2.20 time: 0.344286 Apr 05 11:34:18.162651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 29/43] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:17 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1332 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:18.181437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1960177927", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:18.296018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] validate_networks() for [('912aa55e-5878-42db-a34a-a968382fba80', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:34:18.823040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:18.830590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-41c33b20-ec6a-4326-aa9b-d92f61a633b9 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 1.336676 Apr 05 11:34:18.847067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 15/44] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:17 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:18.863181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:18.863181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:18.897592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:18.898100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:18.904643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:18.905243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:19.450702 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:19.458601 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-61461d8c-d3f0-44d7-9a2f-0b6bdcd46ef3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.610124 Apr 05 11:34:19.472206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 16/45] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:18 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:19.483340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:19.484335 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:19.491253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:19.492416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:19.493441 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:19.494104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:19.705050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:19.718580 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:19.725832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:19.734603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a3039574-002c-4968-acc2-44054ef6f254 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1338 microversion: 2.20 time: 0.260817 Apr 05 11:34:19.735241 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 17/46] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:19 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1338 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:19.831738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:34:19.832222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:34:19.832653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:34:19.841816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:34:19.841816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:34:19.857893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:19.858803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:19.860098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:19.860730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:19.904326 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:19.910612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for user 3185ec21337a4154b650b30b89519716 and project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:19.942178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:34:19.959952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:34:20.217707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1bdfefd-ed39-4f15-b64f-09752b1ea70c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.052580 Apr 05 11:34:20.223105 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 30/47] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:34:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:34:20.225171 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:20.226665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:20.233742 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.234539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.235483 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.235933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.240350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-0871c729-0e4c-46e7-9c7d-fcc2a6a45f1d req-614e4114-a26e-484e-b8e5-0a4a85d26bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271ec1c3-3848-4d8c-99be-ecc15be7f06f", "tag": "42c2fac1-dd03-4da9-ac7d-dec991381e3a"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:20.257901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0871c729-0e4c-46e7-9c7d-fcc2a6a45f1d req-614e4114-a26e-484e-b8e5-0a4a85d26bdf service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.258896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0871c729-0e4c-46e7-9c7d-fcc2a6a45f1d req-614e4114-a26e-484e-b8e5-0a4a85d26bdf service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.299753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-0871c729-0e4c-46e7-9c7d-fcc2a6a45f1d req-614e4114-a26e-484e-b8e5-0a4a85d26bdf service nova] Creating event network-changed:42c2fac1-dd03-4da9-ac7d-dec991381e3a for instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f on hv-cinder-83444 Apr 05 11:34:20.309154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-0871c729-0e4c-46e7-9c7d-fcc2a6a45f1d req-614e4114-a26e-484e-b8e5-0a4a85d26bdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.569870 Apr 05 11:34:20.312454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 18/48] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:20.323748 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0a470119-6bdb-4a60-9663-def6439979fe tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:20.324490 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0a470119-6bdb-4a60-9663-def6439979fe tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:20.502014 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0a470119-6bdb-4a60-9663-def6439979fe tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:20.511567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0a470119-6bdb-4a60-9663-def6439979fe tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1222 microversion: 2.1 time: 0.197132 Apr 05 11:34:20.522324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 19/49] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:20 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:20.536820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:20.537072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:20.551321 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.552047 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.552857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.553857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.667496 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:20.683853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91f98978-5ee4-4b1b-bb92-a9c85c1bee26 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.463651 Apr 05 11:34:20.685560 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 31/50] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:20 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:20.848888 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-b1b744d8-d611-4586-9039-0c1ee12cff4c req-27ad1d9b-f518-45fe-84a3-48ae58cdb9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa16bad4-76dd-4c1b-860c-26cc38b192ef", "name": "network-vif-plugged", "status": "completed", "tag": "cef96bf1-0c42-42f7-a9fa-681679365ad3"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:20.869042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b1b744d8-d611-4586-9039-0c1ee12cff4c req-27ad1d9b-f518-45fe-84a3-48ae58cdb9c4 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.869573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b1b744d8-d611-4586-9039-0c1ee12cff4c req-27ad1d9b-f518-45fe-84a3-48ae58cdb9c4 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.877564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:20.892017 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-61dee0f6-6df4-4730-92cb-9f18946af113 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.366173 Apr 05 11:34:20.896835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-b1b744d8-d611-4586-9039-0c1ee12cff4c req-27ad1d9b-f518-45fe-84a3-48ae58cdb9c4 service nova] Creating event network-vif-plugged:cef96bf1-0c42-42f7-a9fa-681679365ad3 for instance fa16bad4-76dd-4c1b-860c-26cc38b192ef on hv-cinder-83444 Apr 05 11:34:20.897758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b1b744d8-d611-4586-9039-0c1ee12cff4c req-27ad1d9b-f518-45fe-84a3-48ae58cdb9c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:34:20.899013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.899696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.900694 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.901206 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.909638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 20/51] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:20 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:20.910469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.compute.rpcapi [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:34:20.911583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] Releasing lock "compute-rpcapi-router" {{(pid=124242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:34:20.924765 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:20.927509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:20.945336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.945878 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.947364 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:20.947895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:20.948665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d878f659-0e2f-4112-ad3f-8e0576ea5add None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261513 Apr 05 11:34:20.949649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 32/52] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:21.348149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:21.357326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:21.359186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:21.360644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-41b7d4c6-0c6a-4269-97c4-2967fbd6ea62 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.448909 Apr 05 11:34:21.361458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 21/53] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:20 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:21.530176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:21.531309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:21.540182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:21.541024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:21.542037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:21.543019 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:21.656357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:21.680027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-940698f0-a2df-42a7-a2cb-27da5f7e6768 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1226 microversion: 2.1 time: 0.154614 Apr 05 11:34:21.685569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 33/54] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:21 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:21.703926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:21.704549 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:21.725920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:21.726384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:21.735180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:21.735918 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:21.840344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1901114848", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83da91da-2a37-43a9-b807-df1a6d29d057"}], "security_groups": [{"name": "tempest-securitygroup--1302487725"}], "key_name": "tempest-keypair-611072145", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:22.050524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] validate_networks() for [('83da91da-2a37-43a9-b807-df1a6d29d057', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:34:22.247063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:22.255183 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b25f11d4-6366-4fea-a1fb-d0171dde560a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.555156 Apr 05 11:34:22.260272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 22/55] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:21 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:22.265874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:22.266735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:22.279114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.283122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.292798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.293532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.605895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:22.633516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9843414d-30c5-449e-8951-e76da0d9b7a2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.371469 Apr 05 11:34:22.640343 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 23/56] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:22 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:22.646108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:22.647772 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:22.654382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.655112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.656182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.656689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.897971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:34:22.898868 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:34:22.899706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:34:22.900464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:34:22.901682 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:34:22.911940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.913125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.914251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:22.914794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:22.935518 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:34:22.940298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:34:22.954048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:34:22.956429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:34:22.970738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:22.987844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:22.992743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:22.995239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-55927108-2860-4f0d-8723-bc61569b9a81 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.352983 Apr 05 11:34:22.999632 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 24/57] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:22 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:23.008956 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-d6c7e0e6-ab23-4263-ba63-5fef61c3afc6 req-ba2414ba-895a-49af-b7b6-466ddbe249de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:23.024196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d6c7e0e6-ab23-4263-ba63-5fef61c3afc6 req-ba2414ba-895a-49af-b7b6-466ddbe249de service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.024833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d6c7e0e6-ab23-4263-ba63-5fef61c3afc6 req-ba2414ba-895a-49af-b7b6-466ddbe249de service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.038157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-d6c7e0e6-ab23-4263-ba63-5fef61c3afc6 req-ba2414ba-895a-49af-b7b6-466ddbe249de service nova] Creating event network-changed:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:34:23.043808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-d6c7e0e6-ab23-4263-ba63-5fef61c3afc6 req-ba2414ba-895a-49af-b7b6-466ddbe249de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044022 Apr 05 11:34:23.044867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 25/58] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:23.050225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:23.051130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:23.058163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.058719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.059572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.060018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.127510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6b6c6abb-11af-4abf-903c-86c5db7edadc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.296872 Apr 05 11:34:23.128311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 34/59] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:34:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:34:23.139142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9264375c-a7e5-4809-9a14-862471cd7ff2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:23.140031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9264375c-a7e5-4809-9a14-862471cd7ff2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:23.149090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:23.163948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aba4ac40-0132-4548-ab9c-7813fd77cd75 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1274 microversion: 2.1 time: 0.117631 Apr 05 11:34:23.164730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 26/60] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:23 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:23.202782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9264375c-a7e5-4809-9a14-862471cd7ff2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:23.210294 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9264375c-a7e5-4809-9a14-862471cd7ff2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1241 microversion: 2.1 time: 0.074160 Apr 05 11:34:23.224050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 35/61] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:23 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:23.277209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:23.278369 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:23.294609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.294609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.294609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.294609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.656230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:23.661000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:23.665577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.676226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.677242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:23.677812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:23.976186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:23.989059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-813d5293-47f8-484d-a1d1-3426c6df71a6 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1314 microversion: 2.1 time: 0.716456 Apr 05 11:34:23.999183 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 27/62] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:23 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:24.026292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:24.030082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:24.065794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:24.066714 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:24.069887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:24.072832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:24.243858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.267942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d3a5f7d-6adf-441f-be44-f5477121d0de tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.615491 Apr 05 11:34:24.270145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 36/63] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:23 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:24.289598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:24.291740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:24.309751 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:24.310695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:24.313710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:24.314332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:24.357596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.371177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.374247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.379257 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-21353f87-c398-4cc3-a85e-8cb12f4995bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.361270 Apr 05 11:34:24.381921 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 28/64] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:24 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:24.413454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3136c2b7-a657-40f7-9c41-c42fc98f83ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:24.416301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3136c2b7-a657-40f7-9c41-c42fc98f83ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:24.463174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.472639 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d6a9918-d500-476c-9513-6de71bfefe39 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1292 microversion: 2.1 time: 0.201132 Apr 05 11:34:24.491497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 37/65] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:24 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1292 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:24.555089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3136c2b7-a657-40f7-9c41-c42fc98f83ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:24.561955 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3136c2b7-a657-40f7-9c41-c42fc98f83ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1241 microversion: 2.1 time: 0.178484 Apr 05 11:34:24.573334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 29/66] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:24 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1241 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:25.007374 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:25.008344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:25.016429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.020331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.021798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.024448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.177902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.186731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef6c65f5-95de-42a2-b8bd-1dd9a93e053d tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1501 microversion: 2.1 time: 0.184419 Apr 05 11:34:25.187566 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 38/67] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:25 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:25.296386 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:25.300476 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:25.321061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.322165 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.324077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.324533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.400046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:25.400876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:25.407026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.407522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.408307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.409111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.551345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.560185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.561865 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.563246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96e54756-96e2-488c-b45d-9e76c019502d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.168508 Apr 05 11:34:25.564241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 39/68] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:25 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:25.578533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:25.579710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:25.601621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.604466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.605941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.607853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.733354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.744806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63bcbaef-29bb-4ac6-a898-44e37f7fd77a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1280 microversion: 2.1 time: 0.177993 Apr 05 11:34:25.745419 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 40/69] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:25 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:25.762237 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-54edb20e-cfa4-4869-9f29-52fdaa690b92 req-5266e06e-53ac-4c62-9f27-7eeb594618f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f8790e-86d5-4392-8b87-74f29cb57aa1", "tag": "9f189aab-4ee0-4998-b00f-266952c9e388"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:25.808371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-54edb20e-cfa4-4869-9f29-52fdaa690b92 req-5266e06e-53ac-4c62-9f27-7eeb594618f2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.811057 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-54edb20e-cfa4-4869-9f29-52fdaa690b92 req-5266e06e-53ac-4c62-9f27-7eeb594618f2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.834734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-54edb20e-cfa4-4869-9f29-52fdaa690b92 req-5266e06e-53ac-4c62-9f27-7eeb594618f2 service nova] Creating event network-changed:9f189aab-4ee0-4998-b00f-266952c9e388 for instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 on hv-cinder-83444 Apr 05 11:34:25.851803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-54edb20e-cfa4-4869-9f29-52fdaa690b92 req-5266e06e-53ac-4c62-9f27-7eeb594618f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092936 Apr 05 11:34:25.853650 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 41/70] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:25.861677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:25.867396 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.874600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:25.876820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6ace7b8d-5b68-4e65-ae9f-85781e8d0676 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.594021 Apr 05 11:34:25.877839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 30/71] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:25 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:25.884416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.884922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.885632 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.886067 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.899882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-54dc6445-0f9e-4fe0-b94b-2e53339201d1 req-34b9f039-f059-4e0b-8c78-fcb638a3c29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271ec1c3-3848-4d8c-99be-ecc15be7f06f", "name": "network-vif-plugged", "status": "completed", "tag": "42c2fac1-dd03-4da9-ac7d-dec991381e3a"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:25.908869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-54dc6445-0f9e-4fe0-b94b-2e53339201d1 req-34b9f039-f059-4e0b-8c78-fcb638a3c29d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:25.910158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-54dc6445-0f9e-4fe0-b94b-2e53339201d1 req-34b9f039-f059-4e0b-8c78-fcb638a3c29d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:25.925819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-54dc6445-0f9e-4fe0-b94b-2e53339201d1 req-34b9f039-f059-4e0b-8c78-fcb638a3c29d service nova] Creating event network-vif-plugged:42c2fac1-dd03-4da9-ac7d-dec991381e3a for instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f on hv-cinder-83444 Apr 05 11:34:25.932559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-54dc6445-0f9e-4fe0-b94b-2e53339201d1 req-34b9f039-f059-4e0b-8c78-fcb638a3c29d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Apr 05 11:34:25.935520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 31/72] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:34:25.970858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:25.985671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-09e4fe93-2406-4a60-b98c-5b822ff77f47 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1245 microversion: 2.1 time: 0.130260 Apr 05 11:34:25.986354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 42/73] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:25 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:26.582937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:26.583665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:26.590418 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.590906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.591693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.592130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.736250 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:26.744993 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:26.746523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:26.747669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9157320f-6ff2-42d8-b995-569f9325ea8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.169082 Apr 05 11:34:26.758342 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 32/74] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:26 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:26.763185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:26.763185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:26.769214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.769676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.770459 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.770900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.893991 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:26.894617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:26.901796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.902246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.903388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:26.904183 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:26.988458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:26.997770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a400be6f-befe-4b8b-a447-3e89ddbaf56b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.239517 Apr 05 11:34:26.999046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 43/75] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:26 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:27.008702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:27.009578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:27.016535 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:27.018438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:27.020606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:27.023826 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:27.077618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:27.086563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-085f4ff7-20ce-4a84-93c1-a00df590955f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.196351 Apr 05 11:34:27.092704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 33/76] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:26 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:27.104072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:27.111768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-64bd3c00-5a65-44b6-943f-4b5cf3851be2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1237 microversion: 2.1 time: 0.111352 Apr 05 11:34:27.112351 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 44/77] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:26 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1237 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:27.765102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:27.765713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:27.772221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:27.772690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:27.773562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:27.774013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:27.913674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:27.927603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:27.929383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:27.930532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e4f998ff-3049-40e2-9947-abca69239e7d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.169298 Apr 05 11:34:27.931045 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 34/78] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:27 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:28.015103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:28.015742 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:28.022278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.022737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.023551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.023989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.106113 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:28.106747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:28.112775 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.113414 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.114201 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.114643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.165475 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:28.172793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-abfdec5e-4597-42e4-91f6-ecca8051b685 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.161528 Apr 05 11:34:28.173443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 45/79] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:28 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:28.178579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:28.179397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:28.198647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.200125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.201320 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.201827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.281301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:28.289390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f4723155-33bd-425c-88a1-91a4f15a0eb0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1237 microversion: 2.1 time: 0.114535 Apr 05 11:34:28.290037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 46/80] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:28 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:28.291806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:28.299431 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-56b6edd2-fa16-43be-83d3-30a70ebc7667 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.199770 Apr 05 11:34:28.300166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 35/81] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:28 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:28.950043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:28.950686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:28.956524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.956983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:28.957776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:28.958217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.101846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.109706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.111216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.112362 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-25a58c9c-430a-49e4-bdc2-0ac6eae3243e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.166170 Apr 05 11:34:29.112934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 47/82] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:28 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:29.189404 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:29.190015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:29.197682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.198139 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.198938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.199365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.308669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:29.309509 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:29.319369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.320088 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.321334 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.321950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.417761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.429526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd6f0407-d83f-46ca-9fd3-f5344a02521c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1237 microversion: 2.1 time: 0.123177 Apr 05 11:34:29.430179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 48/83] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:29 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1237 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:29.435555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:29.436461 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:29.445098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.445599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.446680 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:29.447126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:29.549753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.559121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-04e78bed-aefa-4a22-b0ce-6cb855b4c09f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.373508 Apr 05 11:34:29.564195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 36/84] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:29 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:29.703532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:29.711185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b89244e-91bc-4a61-9b1a-ee2bff0afb30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.279880 Apr 05 11:34:29.711873 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 49/85] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:29 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:30.130880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:30.132245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:30.140127 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.142856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.143740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.144350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.176982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-5ee53d6e-b9da-4cf9-a20f-82330edfa888 req-9279509c-730f-4bf1-aa0b-2b9463381647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2fd886b-f0e3-4596-bdec-cdfa852af6a3", "tag": "2fb694b4-1fdd-4b95-9ce5-859afbba5e16"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:30.198981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5ee53d6e-b9da-4cf9-a20f-82330edfa888 req-9279509c-730f-4bf1-aa0b-2b9463381647 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.199454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5ee53d6e-b9da-4cf9-a20f-82330edfa888 req-9279509c-730f-4bf1-aa0b-2b9463381647 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.215076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-5ee53d6e-b9da-4cf9-a20f-82330edfa888 req-9279509c-730f-4bf1-aa0b-2b9463381647 service nova] Creating event network-changed:2fb694b4-1fdd-4b95-9ce5-859afbba5e16 for instance e2fd886b-f0e3-4596-bdec-cdfa852af6a3 on hv-cinder-83444 Apr 05 11:34:30.220177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-5ee53d6e-b9da-4cf9-a20f-82330edfa888 req-9279509c-730f-4bf1-aa0b-2b9463381647 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047001 Apr 05 11:34:30.221230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 50/86] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:30.346988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.360457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.362981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.364973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-58429220-efad-4c95-b2ba-873a6d431fed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.238554 Apr 05 11:34:30.365998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 37/87] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:30 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:30.447982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:30.448600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:30.454718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.455168 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.456037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.456479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.516498 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.524933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-76d1f3b3-e83e-4a06-8793-81902a4b4099 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1293 microversion: 2.1 time: 0.082431 Apr 05 11:34:30.525506 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 51/88] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:30 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:30.581074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:30.581743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:30.589636 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.590307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.591268 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.591908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.727664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.728659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:30.729267 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:30.735143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.735293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-59d5972d-785b-488d-921f-57dfe54e692d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.157996 Apr 05 11:34:30.735625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.735916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 38/89] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:30 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:30.736399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:30.736896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:30.883595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:30.891270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29441b44-fbb7-4afd-ae1c-445f99c756cf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1362 microversion: 2.1 time: 0.166682 Apr 05 11:34:30.891873 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 52/90] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:30 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:31.102793 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60085153-8424-4ffa-9d77-93e091b2b907"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:31.103968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:31.110124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.110712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.111524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.111964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.384758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:31.385298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:31.391120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.391615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.392386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.392876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.533522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:31.542735 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:31.544279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:31.545388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-60fd5b77-c829-4362-ac2e-e24241d2ac2d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.165265 Apr 05 11:34:31.545954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 53/91] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:31 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:31.550246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:31.550849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:31.556667 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.557126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.557891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.558329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.618637 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:31.625852 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2ae2d4d1-7af3-4280-b000-bd733639f374 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1293 microversion: 2.1 time: 0.078954 Apr 05 11:34:31.626615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 54/92] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:31 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:31.752877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:31.753495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:31.759803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.760257 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.761032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.761469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.894186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:31.902043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e555ddc5-54d9-41a1-99b4-11684ac09485 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.153063 Apr 05 11:34:31.902805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 55/93] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:31 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:31.908134 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:31.908728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:31.914480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.914928 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:31.915711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:31.916142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.044216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:32.051488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c5557f7-5ebd-4d0d-9553-9398ba9f37ed tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1548 microversion: 2.1 time: 0.146827 Apr 05 11:34:32.052063 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 56/94] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:31 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:32.070787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:32.071640 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:32.079605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.079605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.079605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.079905 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.202124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-41363ffb-0ed8-4ac0-bbed-16e720cd440d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137676 Apr 05 11:34:32.202759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 57/95] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:34:32 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:34:32.572700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:32.573334 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:32.580052 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.580506 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.581282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.581722 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.720146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:32.729211 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:32.730738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:32.731913 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a5cb7f0-bd8c-4f3a-a2cb-ca30ff4d2b76 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.163573 Apr 05 11:34:32.732479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 58/96] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:32 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:32.737078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:32.737685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:32.744611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.745071 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.745857 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.746293 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.807574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:32.815529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c5dcd09-7fb5-46b7-be74-6a8c2dcf5aad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1293 microversion: 2.1 time: 0.081969 Apr 05 11:34:32.816147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 59/97] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:32 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:32.919222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:32.919787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:32.925633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.926086 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:32.926852 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:32.927288 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.063723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:33.071949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ffe8076-6fd3-4945-abd7-f4740a5848f3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.156643 Apr 05 11:34:33.072524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 60/98] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:32 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:33.234007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-3a4bdba0-e925-465d-b359-4bc35b67fbc4 req-78f34bbd-216f-474a-9f26-e064d6770560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "name": "network-vif-plugged", "status": "completed", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:33.243486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-3a4bdba0-e925-465d-b359-4bc35b67fbc4 req-78f34bbd-216f-474a-9f26-e064d6770560 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.243938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-3a4bdba0-e925-465d-b359-4bc35b67fbc4 req-78f34bbd-216f-474a-9f26-e064d6770560 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.256881 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-3a4bdba0-e925-465d-b359-4bc35b67fbc4 req-78f34bbd-216f-474a-9f26-e064d6770560 service nova] Creating event network-vif-plugged:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:34:33.261725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-3a4bdba0-e925-465d-b359-4bc35b67fbc4 req-78f34bbd-216f-474a-9f26-e064d6770560 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031415 Apr 05 11:34:33.262645 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 61/99] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:34:33.690693 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-940a565f-fce0-4b25-9316-3c86038411f4 req-b9a2e804-bfd4-4879-98b2-e0659658b262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271ec1c3-3848-4d8c-99be-ecc15be7f06f", "tag": "42c2fac1-dd03-4da9-ac7d-dec991381e3a"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:33.699801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-940a565f-fce0-4b25-9316-3c86038411f4 req-b9a2e804-bfd4-4879-98b2-e0659658b262 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.700251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-940a565f-fce0-4b25-9316-3c86038411f4 req-b9a2e804-bfd4-4879-98b2-e0659658b262 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.711468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-940a565f-fce0-4b25-9316-3c86038411f4 req-b9a2e804-bfd4-4879-98b2-e0659658b262 service nova] Creating event network-changed:42c2fac1-dd03-4da9-ac7d-dec991381e3a for instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f on hv-cinder-83444 Apr 05 11:34:33.716205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-940a565f-fce0-4b25-9316-3c86038411f4 req-b9a2e804-bfd4-4879-98b2-e0659658b262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029470 Apr 05 11:34:33.716793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 62/100] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:34:33.750481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:33.751210 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:33.758369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.758820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.759627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.760067 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.894937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:33.903616 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:33.905125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:33.906237 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ee297f5-cca9-464c-9a3d-3646a1301854 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.159979 Apr 05 11:34:33.906801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 63/101] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:33 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:33.911624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:33.912447 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:33.920480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.920939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.923713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:33.923713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:33.980768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:33.988068 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18a653f8-e955-4b95-96f1-51904d5995de tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1293 microversion: 2.1 time: 0.080319 Apr 05 11:34:33.988640 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 64/102] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:33 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:34.089208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:34.089867 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:34.096138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:34.096605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:34.097417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:34.097911 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:34.237401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:34.246798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97b8a5c6-f877-4fe5-a4d5-3b32e64c4c2a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.161354 Apr 05 11:34:34.247740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 65/103] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:34 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:34.924614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:34.925276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:34.931937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:34.932387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:34.933160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:34.933592 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:35.085813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:35.094058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:35.096306 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:35.096844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb3f75ff-4a78-49e2-9d13-aa26ff7a911e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.176103 Apr 05 11:34:35.106145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 66/104] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:34 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:35.111331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:35.112158 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:35.119870 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:35.120627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:35.121359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:35.121856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:35.188848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:35.197786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73d7bd9e-17a1-4cc2-b6f0-86da27e49e2c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1301 microversion: 2.1 time: 0.090159 Apr 05 11:34:35.198486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 67/105] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:35 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:35.265196 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:35.266010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:35.276809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:35.276809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:35.279825 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:35.281538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:35.531150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:35.544445 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-102df996-d392-412e-ba24-ca8d55ed7c8f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.284393 Apr 05 11:34:35.545176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 68/106] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:35 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:36.093425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4861a2f0-3f0e-445f-8c3a-0ae3d2f36035 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "POST /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.995402 Apr 05 11:34:36.094944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 39/107] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:34:31 2022] POST /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef/os-volume_attachments => generated 194 bytes in 4998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:34:36.115591 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:36.127003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:36.143463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.144284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.145533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.146859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.217031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:36.218000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:36.228173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.232851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.233745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.234201 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.342659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:36.353140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3e97f73e-0310-47a0-913d-f482139bba46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1311 microversion: 2.1 time: 0.141588 Apr 05 11:34:36.363907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 40/108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:36 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:36.377846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:36.388791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:36.391108 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:36.395589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66a2813c-d75a-47f8-89dd-f585c2041b02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.280892 Apr 05 11:34:36.395589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 69/109] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:36 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:36.561334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:36.561946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:36.569169 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.569624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.570399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:36.570837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:36.727956 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:36.735764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8bcf237f-949f-4443-b0ac-a3f1bbe89396 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.178091 Apr 05 11:34:36.736352 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 41/110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:36 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:37.370062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:37.370676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:37.376728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.377185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.377993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.378427 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.412546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:37.413171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:37.419688 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.420136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.420905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.421340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.515490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:37.523887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-667777b2-825a-42c4-bf1e-4bcd6fe8b301 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.157621 Apr 05 11:34:37.524467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 70/111] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:37 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:37.554621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:37.562546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:37.564163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:37.565461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d6ed00a8-c796-48aa-a123-b1ba9a881b54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.156789 Apr 05 11:34:37.566082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 42/112] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:37 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:37.753639 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:37.754239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:37.761179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.761627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.762382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:37.762806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:37.893269 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:37.901154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5557b9da-3cff-4975-994d-c3fc9ffac4c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.151299 Apr 05 11:34:37.901717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 71/113] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:37 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:38.541757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:38.542283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:38.548706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.549161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:38.549938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.550375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:38.583973 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:38.584585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:38.592796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.593241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:38.594025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.594457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:38.689851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:38.697630 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9ec3a6ca-7b24-4a60-9836-7dd1d1fccd35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.159814 Apr 05 11:34:38.698214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 43/114] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:38 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:38.736717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:38.744425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:38.745916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:38.747039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5b3fa1d-3577-447f-846a-e01309757251 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.166972 Apr 05 11:34:38.747625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 72/115] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:38 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:38.918840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:38.919463 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:38.925303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.925748 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:38.926502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:38.926930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:39.060317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:39.067551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c75f51dd-50ea-45a3-9e51-1879e66b961b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.153568 Apr 05 11:34:39.069368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 44/116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:38 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:39.714490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:39.715110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:39.721048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:39.721495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:39.722268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:39.722705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:39.765260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:39.765863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:39.772793 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:39.773496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:39.774439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:39.774876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:39.932649 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:39.946617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:39.948272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:39.949482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e25b773e-bcec-4be6-9721-77f351221069 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.188211 Apr 05 11:34:39.950461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 45/117] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:39 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:39.984041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:39.993497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16e915f4-0a1f-45fd-9bfe-1a24d3438875 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.282871 Apr 05 11:34:39.998252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 73/118] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:39 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:40.085798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:40.086319 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:40.092570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:40.093029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:40.093822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:40.094259 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:40.175235 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-6dcdc2a4-071b-405b-ae60-bd9d59549872 req-c6ef47a4-90e0-4252-8b77-3f44d0b6b4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78373594-67e2-4cfc-8b01-6417123e373b", "tag": "9aac8d4b-83d8-4a48-87aa-17a88f5ed914"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:40.195398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6dcdc2a4-071b-405b-ae60-bd9d59549872 req-c6ef47a4-90e0-4252-8b77-3f44d0b6b4ae service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:40.196446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6dcdc2a4-071b-405b-ae60-bd9d59549872 req-c6ef47a4-90e0-4252-8b77-3f44d0b6b4ae service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:40.215399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-6dcdc2a4-071b-405b-ae60-bd9d59549872 req-c6ef47a4-90e0-4252-8b77-3f44d0b6b4ae service nova] Creating event network-changed:9aac8d4b-83d8-4a48-87aa-17a88f5ed914 for instance 78373594-67e2-4cfc-8b01-6417123e373b on hv-cinder-83444 Apr 05 11:34:40.221819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-6dcdc2a4-071b-405b-ae60-bd9d59549872 req-c6ef47a4-90e0-4252-8b77-3f44d0b6b4ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050087 Apr 05 11:34:40.223205 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 74/119] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:40.277657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:40.285673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b591f6d0-f007-4eb6-8453-90f797bc84dd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.203930 Apr 05 11:34:40.286266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 46/120] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:40 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:40.967752 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:40.968402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:40.974917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:40.975359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:40.976135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:40.976564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:41.011752 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:41.012370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:41.018848 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:41.019303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:41.020110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:41.020553 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:41.116473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:41.124537 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:41.126234 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:41.127352 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b84b0cfb-15de-4f72-9e26-439a67a9bfbe tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.163944 Apr 05 11:34:41.127963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 75/121] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:40 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:34:41.153023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:41.160324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-66f1d493-fbd4-4fbe-8e24-2db3ff1127db tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.152666 Apr 05 11:34:41.160917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 47/122] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:41 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:41.303644 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:41.304255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:41.310150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:41.310596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:41.311357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:41.311812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:41.445304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:41.452513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6f78133-99dc-4fdb-ac3d-97dcb80a91be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.153266 Apr 05 11:34:41.453063 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 76/123] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:41 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:42.146359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:42.147090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:42.153358 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.153816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.154579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.155016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.178114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:42.178961 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:42.184786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.185241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.186015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.186453 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.292589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:42.300778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:42.302361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:42.303677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-75e9c205-1591-4c36-99cd-714aac034857 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1405 microversion: 2.20 time: 0.161643 Apr 05 11:34:42.304572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 48/124] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:42 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:42.329942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:42.338015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e7ea9902-15e9-4337-8ea5-b09bda6537b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.163752 Apr 05 11:34:42.338596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 77/125] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:42 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:42.470033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:42.478642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:42.479706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.480300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.481121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:42.481567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:42.709720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:42.717179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b25269c6-7bc0-4f3a-bb14-40fdfdf59960 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.251278 Apr 05 11:34:42.717788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 49/126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:42 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:43.134042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-1b8b9957-912e-49ce-8de4-850d5ef3d546 req-177ecb96-8109-4023-823d-3215bf55fc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f8790e-86d5-4392-8b87-74f29cb57aa1", "name": "network-vif-plugged", "status": "completed", "tag": "9f189aab-4ee0-4998-b00f-266952c9e388"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:43.142806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1b8b9957-912e-49ce-8de4-850d5ef3d546 req-177ecb96-8109-4023-823d-3215bf55fc44 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.143244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1b8b9957-912e-49ce-8de4-850d5ef3d546 req-177ecb96-8109-4023-823d-3215bf55fc44 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.156213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-1b8b9957-912e-49ce-8de4-850d5ef3d546 req-177ecb96-8109-4023-823d-3215bf55fc44 service nova] Creating event network-vif-plugged:9f189aab-4ee0-4998-b00f-266952c9e388 for instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 on hv-cinder-83444 Apr 05 11:34:43.163635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-1b8b9957-912e-49ce-8de4-850d5ef3d546 req-177ecb96-8109-4023-823d-3215bf55fc44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Apr 05 11:34:43.164440 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 78/127] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:43.322010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:43.322645 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:43.328643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.329142 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.329895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.330352 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.355071 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:43.355804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:43.362886 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.363437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.364596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.365655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.470545 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:43.479359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:43.481284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:43.482476 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c06bb91b-ec28-40b3-8bcd-55376bc0ce4a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1597 microversion: 2.20 time: 0.164949 Apr 05 11:34:43.483060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 50/128] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:34:43 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:34:43.500728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:43.501224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:43.501349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:43.508002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.508457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.508848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-456a06ec-8bdc-4558-9ba0-ced7360897e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.157973 Apr 05 11:34:43.520701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.521166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 79/129] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:43 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:43.521256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.598503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-80a3b66a-e8ef-47bc-8ebb-27e270bdbb1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101548 Apr 05 11:34:43.599778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 51/130] 10.222.0.60 () {60 vars in 1315 bytes} [Tue Apr 5 11:34:43 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:34:43.734512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:43.738513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:43.741927 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.742377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:43.743239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:43.743765 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:44.029025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:44.036624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-389e8109-0ee4-47af-aba2-3ba2f10eca15 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.306182 Apr 05 11:34:44.037292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 80/131] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:43 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:44.536274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:44.537001 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:44.543106 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:44.543526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:44.544303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:44.544750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:44.682279 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:44.689559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e32dd0cf-6e86-48c9-8f74-2476ed37ea46 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.157501 Apr 05 11:34:44.690123 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 52/132] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:44 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:45.092357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:45.092357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:45.092357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:45.092357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:45.093414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:45.093414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:45.288244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:45.297776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-34b15c84-6e47-43de-8673-1a6e39c7d2d6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.248020 Apr 05 11:34:45.308289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 81/133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:45 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:45.384180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-29522582-3406-4ef8-9ecc-bba2e1f4773d req-29bb7a5e-f792-4c8d-91d2-47658262f924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:45.393190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-29522582-3406-4ef8-9ecc-bba2e1f4773d req-29bb7a5e-f792-4c8d-91d2-47658262f924 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:45.393635 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-29522582-3406-4ef8-9ecc-bba2e1f4773d req-29bb7a5e-f792-4c8d-91d2-47658262f924 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:45.406728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-29522582-3406-4ef8-9ecc-bba2e1f4773d req-29bb7a5e-f792-4c8d-91d2-47658262f924 service nova] Creating event network-changed:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:34:45.412796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-29522582-3406-4ef8-9ecc-bba2e1f4773d req-29bb7a5e-f792-4c8d-91d2-47658262f924 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036494 Apr 05 11:34:45.413640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 53/134] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:45.710955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:45.711828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:45.719808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:45.722596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:45.725333 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:45.725980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:45.887678 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:45.895368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f08cc159-940d-428d-8e57-242f0eb5e6d0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.188997 Apr 05 11:34:45.896901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 82/135] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:45 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:46.316061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:46.316761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:46.324051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:46.324511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:46.328257 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:46.328257 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:46.516638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:46.524666 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4657101c-2a6b-4d25-bd8e-d732edfc03e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.213230 Apr 05 11:34:46.525795 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 54/136] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:46 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:46.912866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:46.913495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:46.919325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:46.919814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:46.920578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:46.921016 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:47.058003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:47.065359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-79385f28-242c-4317-b6f7-60a25fb7f82d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.156314 Apr 05 11:34:47.065931 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 83/137] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:46 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:47.541844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:47.543146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:47.550164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:47.550947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:47.552000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:47.552820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:47.962769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:47.981464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0298b974-65e2-456c-840d-f9e12d825b69 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.441171 Apr 05 11:34:47.982187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 55/138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:47 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:48.082272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:48.082927 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:48.089481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:48.089930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:48.091030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:48.091543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:48.251595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:48.259325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bed19727-437e-4db1-83ac-e44e9335f7cb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.181094 Apr 05 11:34:48.259930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 84/139] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:48 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:48.999446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:49.000251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:49.007339 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:49.007819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:49.008594 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:49.009035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:49.144567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:49.152551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-374cfeef-ea93-49d1-9583-bfb3fca586be tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.156906 Apr 05 11:34:49.153122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 56/140] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:48 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:49.276151 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:49.276759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:49.284991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:49.285907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:49.286785 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:49.287243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:49.314659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-012ccdf0-59b2-4cd9-9234-70d529603c33 req-60ca9d07-ec6d-484b-b216-e763b7e6b3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2fd886b-f0e3-4596-bdec-cdfa852af6a3", "name": "network-vif-plugged", "status": "completed", "tag": "2fb694b4-1fdd-4b95-9ce5-859afbba5e16"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:34:49.323867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-012ccdf0-59b2-4cd9-9234-70d529603c33 req-60ca9d07-ec6d-484b-b216-e763b7e6b3de service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:49.324859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-012ccdf0-59b2-4cd9-9234-70d529603c33 req-60ca9d07-ec6d-484b-b216-e763b7e6b3de service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:49.342033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-012ccdf0-59b2-4cd9-9234-70d529603c33 req-60ca9d07-ec6d-484b-b216-e763b7e6b3de service nova] Creating event network-vif-plugged:2fb694b4-1fdd-4b95-9ce5-859afbba5e16 for instance e2fd886b-f0e3-4596-bdec-cdfa852af6a3 on hv-cinder-83444 Apr 05 11:34:49.347717 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-012ccdf0-59b2-4cd9-9234-70d529603c33 req-60ca9d07-ec6d-484b-b216-e763b7e6b3de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036564 Apr 05 11:34:49.349306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 57/141] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:34:49.439672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:49.449319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e5b1555f-297d-4988-9bf1-3683f28ec4e4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.176932 Apr 05 11:34:49.449989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 85/142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:49 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:50.170232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:50.170934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:50.177042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:50.177488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:50.178416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:50.178853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:50.317758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:50.326540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3a412118-98de-40d3-9820-c60e2906b575 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.160889 Apr 05 11:34:50.335640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 58/143] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:50 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:50.466368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:50.466968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:50.472920 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:50.473367 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:50.474168 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:50.474605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:50.607627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:50.619303 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f081c3eb-35d2-4d94-b8dc-9ae00b68e49c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.156886 Apr 05 11:34:50.619915 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 86/144] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:50 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:51.344663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:51.345357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:51.352721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:51.353179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:51.355487 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:51.355487 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:51.492999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:51.500263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-63c6f35f-e65f-4fcd-900e-3b497bbecfd2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.160135 Apr 05 11:34:51.500835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 59/145] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:51 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:51.636823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:51.654876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:51.654876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:51.654876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:51.654876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:51.655243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:51.782512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:51.789898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-69fea55d-d0b1-4683-8e12-3bb679a9ab9c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.156834 Apr 05 11:34:51.790474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 87/146] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:51 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:52.517452 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:52.518069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:52.524523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:52.524980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:52.525754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:52.526192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:52.659859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:52.668042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-26b75c0c-b4c9-4cfc-ba42-7e20ab0c7131 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.154534 Apr 05 11:34:52.668663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 60/147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:52 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:52.806492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:52.807141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:52.813023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:52.813471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:52.814258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:52.814679 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:52.948341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:52.955768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0f7b713-bbb7-47cf-9432-94b0d98b23fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.153325 Apr 05 11:34:52.956282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 88/148] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:52 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:53.685539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:53.686151 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:53.693131 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:53.693707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:53.694600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:53.695043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:53.834917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:53.842185 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fc86dca3-91e2-49f9-a236-84ca9e4d8e8c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.160549 Apr 05 11:34:53.842747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 61/149] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:53 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:53.972466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:53.973155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:53.979142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:53.979649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:53.980418 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:53.980854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:54.129379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:54.138297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c60ad423-f73b-4166-81e1-727e4ab4885d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.169634 Apr 05 11:34:54.138872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 89/150] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:53 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:54.860063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:54.860680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:54.867495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:54.867949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:54.868723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:54.869159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:55.155313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:55.155960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:55.164720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:55.165422 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:55.166203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:55.166824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:55.239357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:55.246945 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5953305b-309f-4c7e-a37c-a668d9949982 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.390687 Apr 05 11:34:55.247944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 62/151] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:54 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:55.341346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:55.349926 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-019e0250-26a5-4229-a552-d3f1ffca4be0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.198516 Apr 05 11:34:55.350514 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 90/152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:55 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:56.265265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:56.266741 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:56.273310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:56.273850 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:56.274623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:56.275052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:56.372802 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:56.373414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:56.379324 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:56.384529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:56.384529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:56.384529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:56.427557 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:56.435013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-814c5313-0909-4ec6-831b-db55a9d76089 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.173717 Apr 05 11:34:56.435615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 63/153] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:56 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:56.557354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:56.564709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88b27d5d-8908-4f82-8a6d-0b3b97b8c8be tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.195609 Apr 05 11:34:56.565315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 91/154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:56 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:57.453189 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:57.453852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:57.461504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:57.462174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:57.462953 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:57.463395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:57.582124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:57.582797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:57.588893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:57.589350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:57.590137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:57.590564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:57.603234 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:57.610492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-171bf9f6-fb6e-4822-8904-26b495e9e2e0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.161109 Apr 05 11:34:57.611059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 64/155] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:57 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:57.737448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:57.745986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-336070f0-5193-48a4-b7de-17d519a266b1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.167585 Apr 05 11:34:57.746567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 92/156] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:57 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:58.628980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:58.637371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:58.637371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:58.637371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:58.637905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:58.638350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:58.762165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:58.763410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:58.769683 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:58.770618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:58.771608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:58.772036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:58.776059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:58.794894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0bf74c60-0b9c-447f-90a4-9005d672dc9a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.169304 Apr 05 11:34:58.797846 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 65/157] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:58 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:34:58.951887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:58.959292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3977385e-4222-49a5-9bdf-a1d03f2e7bce tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.200970 Apr 05 11:34:58.959900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 93/158] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:58 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:34:59.813825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:59.814639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:59.826251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:59.826961 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:59.828090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:34:59.828520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:34:59.977991 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:34:59.984509 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:34:59.985756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:34:59.986735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f9303cad-a505-4bcf-973e-fc65a645d23c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.176713 Apr 05 11:34:59.987633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 66/159] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:59 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:00.001024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:00.001479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:00.002429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:00.002875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:00.139505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:00.147072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f05d2028-15ef-405e-8877-bb5a452c5d6a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.174636 Apr 05 11:35:00.147689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 94/160] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:34:59 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:01.002854 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:01.003488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:01.010410 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:01.010864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:01.011659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:01.012100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:01.146280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:01.153412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cd7c3080-b76d-4baf-8a0a-259fc0cf0d3e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.154339 Apr 05 11:35:01.153977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 67/161] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:00 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:01.164278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:01.165039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:01.173580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:01.174253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:01.175395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:01.176111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:01.327036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:01.334325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b8e7161-13a3-4ef8-83df-d39ad400626c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.174038 Apr 05 11:35:01.334903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 95/162] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:01 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:02.170028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:02.170548 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:02.177039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:02.177486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:02.178239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:02.178672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:02.306749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:02.313976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c202b431-54b5-46eb-865e-9c8b0d060c95 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.147793 Apr 05 11:35:02.314537 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 68/163] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:02 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:02.351186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:02.351843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:02.357676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:02.358130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:02.358895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:02.359359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:02.491117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:02.498408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f0efc124-ec89-4d7c-a34f-1a366fdbbc89 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.151270 Apr 05 11:35:02.498983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 96/164] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:02 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:03.332092 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:03.333181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:03.339305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:03.339791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:03.340557 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:03.340991 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:03.475115 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:03.482475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-573fc12c-071c-4d32-b2ac-06faa0e3398c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1322 microversion: 2.1 time: 0.154399 Apr 05 11:35:03.483040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 69/165] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:03 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:03.515831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:03.516443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:03.523570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:03.524011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:03.524789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:03.525225 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:03.665779 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:03.674114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0aeb9873-f4eb-426c-88ee-d7daef5e1030 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.161433 Apr 05 11:35:03.679448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 97/166] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:03 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:04.161252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:04.161746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:04.167611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.168070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.168828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.169263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.194741 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:35:04.501077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:04.501077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:04.508224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.508673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.509437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.509862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.590782 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-73b647aa-2e93-4a1e-8420-6085a16e66d7 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 204 len: 0 microversion: 2.1 time: 0.433210 Apr 05 11:35:04.591638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 70/167] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:35:04 2022] DELETE /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:35:04.601367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:04.602101 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:04.609529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.610072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.610933 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.611310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.665161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:04.672725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2341b02d-3045-44b6-85ce-6f18740f9eeb tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1516 microversion: 2.1 time: 0.177187 Apr 05 11:35:04.684907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 98/168] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:04 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:04.690620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:04.693464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:04.701698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.702437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.703365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.703972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.733120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'flavor' on Instance uuid e2fd886b-f0e3-4596-bdec-cdfa852af6a3 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:35:04.819049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:04.827147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-eab1e52b-3683-4f7f-b136-342b57a025c3 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.231024 Apr 05 11:35:04.837819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 71/169] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:04 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:04.837819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:04.837819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:04.847773 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.854971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.854971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:04.854971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:04.993504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:05.005835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c0c676ed-6c43-47d2-b33c-7fc67e9201a3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.176994 Apr 05 11:35:05.015407 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 72/170] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:04 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:05.286389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d666eaa-32a4-46f5-af13-0b554e204dc3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3/action" status: 200 len: 32 microversion: 2.1 time: 0.594203 Apr 05 11:35:05.286389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 99/171] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:35:04 2022] POST /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3/action => generated 32 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:35:05.294581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:05.295317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:05.302350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:05.302883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:05.303787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:05.304296 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:05.450932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-aa9c6b93-43f2-458e-a418-1f9e5e8d8156 req-1c0c919e-0e0a-401e-9296-21ee557210e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78373594-67e2-4cfc-8b01-6417123e373b", "name": "network-vif-plugged", "status": "completed", "tag": "9aac8d4b-83d8-4a48-87aa-17a88f5ed914"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:05.461706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-aa9c6b93-43f2-458e-a418-1f9e5e8d8156 req-1c0c919e-0e0a-401e-9296-21ee557210e8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:05.462390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-aa9c6b93-43f2-458e-a418-1f9e5e8d8156 req-1c0c919e-0e0a-401e-9296-21ee557210e8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:05.473626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-aa9c6b93-43f2-458e-a418-1f9e5e8d8156 req-1c0c919e-0e0a-401e-9296-21ee557210e8 service nova] Creating event network-vif-plugged:9aac8d4b-83d8-4a48-87aa-17a88f5ed914 for instance 78373594-67e2-4cfc-8b01-6417123e373b on hv-cinder-83444 Apr 05 11:35:05.479060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-aa9c6b93-43f2-458e-a418-1f9e5e8d8156 req-1c0c919e-0e0a-401e-9296-21ee557210e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Apr 05 11:35:05.479697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 100/172] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:35:05.491670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:05.500486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aa3d17a6-7459-40a2-94ee-6724ee20fdae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.210241 Apr 05 11:35:05.501084 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 73/173] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:05 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:05.845972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:05.846651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:05.854161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:05.854606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:05.855399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:05.855849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:06.004330 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:06.012183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1429afb1-ef42-4af9-b68c-a981872392f8 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.170266 Apr 05 11:35:06.012754 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 101/174] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:05 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:06.022088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:06.027119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:06.028927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:06.029465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:06.030304 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:06.030809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:06.167342 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:06.176168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5f31c2ea-ef21-46b6-a80f-576bfef0612b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.157954 Apr 05 11:35:06.176740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 74/175] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:06 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:06.522367 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:06.522976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:06.529155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:06.529597 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:06.530669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:06.531116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:06.662671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:06.670078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9632e740-2817-4d00-b0c2-87ee4367892c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.155857 Apr 05 11:35:06.670834 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 102/176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:06 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:07.029461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:07.030078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:07.036786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.037451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.038249 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.038705 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.174095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:07.186345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-61bda9e0-54b5-464e-baa6-68716172011a tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.160863 Apr 05 11:35:07.187330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 75/177] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:07 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:07.193899 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:07.194639 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:07.200478 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.200933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.201705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.202141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.339042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:07.346565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-59db47cb-b125-4ed5-b0f9-6d3f3d2e5d9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.157423 Apr 05 11:35:07.347174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 103/178] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:07 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:07.686892 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:07.687647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:07.693778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.694227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.694978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:07.695407 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:07.875391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:07.882757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a2d66e33-f8e7-47c0-9438-505a3b09a0f9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.199486 Apr 05 11:35:07.883334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 76/179] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:07 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:08.205794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:08.207878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:08.212955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.213402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:08.214176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.214613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:08.348395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:08.356175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0d9ac4f-73bf-46ec-9232-f9a809b9a793 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.154152 Apr 05 11:35:08.356749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 104/180] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:08 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:08.364490 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:08.365104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:08.371475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.371922 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:08.372677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.373102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:08.510708 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:08.518399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3d38c928-8a30-4410-af08-139531f13c70 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.158249 Apr 05 11:35:08.518982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 77/181] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:08 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:08.903207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:08.903848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:08.909697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.910734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:08.911661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:08.912101 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:09.052960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:09.060394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5fa31de-9ced-4aae-83bd-a178d75455cf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.162597 Apr 05 11:35:09.060967 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 105/182] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:08 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:09.375715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:09.376964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:09.384083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:09.384529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:09.385301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:09.385735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:09.535105 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:09.536817 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:09.541990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:09.543394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:09.543969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:09.544750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:09.545310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:09.551829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-71d90d9b-9c4d-4149-8d50-6daba96d1e63 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.179507 Apr 05 11:35:09.552687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 78/183] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:09 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:09.702556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:09.710253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d30b9a9-23cb-495c-8319-00e54dc7038e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.178940 Apr 05 11:35:09.710833 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 106/184] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:09 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:10.077850 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:10.078606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:10.085272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.085728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.086504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.086940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.388176 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:10.397173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5e698863-3c0e-4ca0-8c75-3d85292681ee tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.323108 Apr 05 11:35:10.397759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 79/185] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:10 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:10.569761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:10.570301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:10.576092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.576546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.577312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.577750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.719292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:10.726880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:10.730891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:10.730993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d9db6ec-0835-4268-a245-000e8fae7b47 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.162548 Apr 05 11:35:10.730993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 107/186] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:10 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:10.733683 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.734164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.734927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:10.735587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:10.878023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:10.888486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d3fa69a5-0de2-403a-ad9f-877617f51725 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.165567 Apr 05 11:35:10.889069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 80/187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:10 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:11.414581 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:11.415186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:11.421248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.421721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:11.422847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.423499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:11.561093 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:11.569798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ea247ec-631f-4cf8-bcda-0675bd0c11c0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.159486 Apr 05 11:35:11.570775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 108/188] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:11 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:11.751688 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:11.753119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:11.762710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.766088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:11.766877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.769174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:11.905340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:11.905949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:11.916596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.917060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:11.924947 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:11.924947 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:12.122718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:12.132676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f0f4b15-8d38-4dc3-8680-43660ceedc5d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1367 microversion: 2.1 time: 0.230661 Apr 05 11:35:12.134174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 109/189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:11 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:12.389492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:12.399581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-975d5d5e-468b-493e-8a9f-a7ec830ab60e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1553 microversion: 2.1 time: 0.651684 Apr 05 11:35:12.400372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 81/190] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:11 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1553 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:12.588276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:12.588892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:12.599468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:12.599958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:12.600909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:12.601510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.018155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:13.026884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-f23fda96-5df1-42a5-8190-4b1410726b29 req-adefc5bb-3ce6-4b44-bd3f-6ad885fdc30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa16bad4-76dd-4c1b-860c-26cc38b192ef", "name": "network-vif-deleted", "tag": "cef96bf1-0c42-42f7-a9fa-681679365ad3"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:13.036516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f23fda96-5df1-42a5-8190-4b1410726b29 req-adefc5bb-3ce6-4b44-bd3f-6ad885fdc30a service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.036887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f23fda96-5df1-42a5-8190-4b1410726b29 req-adefc5bb-3ce6-4b44-bd3f-6ad885fdc30a service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.038670 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6157c827-7efe-4ede-87aa-e93b67e53450 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.454186 Apr 05 11:35:13.039512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 110/191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:12 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:13.053607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-f23fda96-5df1-42a5-8190-4b1410726b29 req-adefc5bb-3ce6-4b44-bd3f-6ad885fdc30a service nova] Creating event network-vif-deleted:cef96bf1-0c42-42f7-a9fa-681679365ad3 for instance fa16bad4-76dd-4c1b-860c-26cc38b192ef on hv-cinder-83444 Apr 05 11:35:13.058880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-f23fda96-5df1-42a5-8190-4b1410726b29 req-adefc5bb-3ce6-4b44-bd3f-6ad885fdc30a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036054 Apr 05 11:35:13.060184 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 82/192] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:35:13.150170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:13.150893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:13.156882 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.157428 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.158259 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.159020 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.375515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:13.385531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c15895a-3162-4f2b-8ce8-44aabb0a47d6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1556 microversion: 2.1 time: 0.239195 Apr 05 11:35:13.386230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 111/193] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:13 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:13.405884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:13.406463 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:13.417145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:13.419113 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.419955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:13.420548 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.421493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.421921 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.441126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.442386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.443327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:13.443955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:13.516304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:13.522933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ce511a8f-304e-4121-857f-d98dae641c34 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1345 microversion: 2.1 time: 0.109517 Apr 05 11:35:13.523759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 112/194] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:13 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:13.539925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-afcf4fb0-5e3f-45d3-9d0c-efde4e1f9a49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139518 Apr 05 11:35:13.540516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 83/195] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:35:13 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:35:14.056031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:14.057331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:14.064423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:14.065099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:14.066044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:14.067848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:14.273327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:14.280753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc47c822-c849-4bb0-b98d-5e603e7c80ed tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.228698 Apr 05 11:35:14.281341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 113/196] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:14 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:14.539943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:14.541140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:14.547368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:14.547863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:14.548730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:14.549172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:14.590011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:14.590011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:14.590011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lazy-loading 'fault' on Instance uuid fa16bad4-76dd-4c1b-860c-26cc38b192ef {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:35:14.630519 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2373fbe8344eec8a0601c9eb34c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6424cbfe534f7bb64b4e6653d31a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:14.639368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c260bf92-d35e-48bc-bc78-9a0f76bf4813 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 200 len: 1350 microversion: 2.1 time: 0.103667 Apr 05 11:35:14.640263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 84/197] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:14 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:15.297714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:15.298332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:15.314969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.315718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.316994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.317656 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.488128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-1aab78e6-a2ac-42fb-858f-05276fbbfede req-83d3dca0-8678-4579-87fe-de027dc1fafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78373594-67e2-4cfc-8b01-6417123e373b", "tag": "9aac8d4b-83d8-4a48-87aa-17a88f5ed914"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:15.504737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1aab78e6-a2ac-42fb-858f-05276fbbfede req-83d3dca0-8678-4579-87fe-de027dc1fafd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.505194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1aab78e6-a2ac-42fb-858f-05276fbbfede req-83d3dca0-8678-4579-87fe-de027dc1fafd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.533483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-1aab78e6-a2ac-42fb-858f-05276fbbfede req-83d3dca0-8678-4579-87fe-de027dc1fafd service nova] Creating event network-changed:9aac8d4b-83d8-4a48-87aa-17a88f5ed914 for instance 78373594-67e2-4cfc-8b01-6417123e373b on hv-cinder-83444 Apr 05 11:35:15.546968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-1aab78e6-a2ac-42fb-858f-05276fbbfede req-83d3dca0-8678-4579-87fe-de027dc1fafd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062978 Apr 05 11:35:15.552228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 85/198] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:35:15.658049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:15.658927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:15.666461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.667143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.668287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.668905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.686437 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] HTTP exception thrown: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. Apr 05 11:35:15.687946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Returning 404 to user: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:15.689095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6a9fc53c-a017-4210-afcb-aeb0eb333492 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 404 len: 111 microversion: 2.1 time: 0.035434 Apr 05 11:35:15.690205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 86/199] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:15 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:35:15.708302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:15.716832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dbf18424-cec9-417a-b9d1-7de82a992e74 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.422752 Apr 05 11:35:15.718075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 114/200] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:15 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:15.868924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:15.868924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:15.868924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.868924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.869243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:15.869243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:15.882465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] HTTP exception thrown: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. Apr 05 11:35:15.888372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Returning 404 to user: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:15.897028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-58ddf56e-3ece-4364-a7e7-e4b62b470c76 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062846 Apr 05 11:35:15.898669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 87/201] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:35:15 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:35:16.735100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:16.736076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:16.745427 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:16.748830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:16.748830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:16.748830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:17.064959 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:17.076222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-227ca043-41b2-4a6c-9bcd-ac03bcd5f89a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.344610 Apr 05 11:35:17.077336 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 115/202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:16 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:17.562963 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:17.565492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:17.571293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:17.571908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:17.572789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:17.573881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:17.590769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] HTTP exception thrown: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. Apr 05 11:35:17.591368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Returning 404 to user: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:17.592608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-920238ed-9b36-4c0f-9727-0d67e0a59587 tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 404 len: 111 microversion: 2.1 time: 0.034045 Apr 05 11:35:17.593195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 88/203] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:35:17 2022] DELETE /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:35:17.602039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:17.602766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] [instance: fa16bad4-76dd-4c1b-860c-26cc38b192ef] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:17.608994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:17.610821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:17.610821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:17.611012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:17.625744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] HTTP exception thrown: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. Apr 05 11:35:17.626360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] Returning 404 to user: Instance fa16bad4-76dd-4c1b-860c-26cc38b192ef could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:17.627519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7e7fdc38-dd6e-418d-9cab-5d99012c744e tempest-DeleteServersTestJSON-1706013131 tempest-DeleteServersTestJSON-1706013131-project] 10.222.0.60 "GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef" status: 404 len: 111 microversion: 2.1 time: 0.029835 Apr 05 11:35:17.627798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 116/204] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:17 2022] GET /compute/v2.1/servers/fa16bad4-76dd-4c1b-860c-26cc38b192ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:35:18.096307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:18.097917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:18.107458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:18.107907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:18.108878 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:18.109467 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:18.328338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:18.346322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-128b79c6-7d52-4499-bf43-25f03c53f21b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.248096 Apr 05 11:35:18.346322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 89/205] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:18 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:19.360240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:19.361032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:19.372112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:19.374058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:19.376382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:19.379104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:19.592299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:19.600903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1359dbc5-ea44-44e4-8f76-ea29486595dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.246258 Apr 05 11:35:19.601642 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 117/206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:19 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:20.618809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:20.619442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:20.626690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:20.627109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:20.639383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:20.639383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:20.883562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:20.924761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e6cbb819-49ba-4986-893e-19d6940193d0 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.309892 Apr 05 11:35:20.928956 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 90/207] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:20 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:21.341451 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6550118f-883b-4ae8-8781-86b3772373bb tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Action: 'create', calling method: .version_select at 0x7f13837d0040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1043610255", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:21.342928 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6550118f-883b-4ae8-8781-86b3772373bb tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.343780 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6550118f-883b-4ae8-8781-86b3772373bb tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.184729 Apr 05 11:35:21.344325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 118/208] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Apr 5 11:35:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:35:21.353685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-05b0b9c3-44dc-492d-94a3-1f315609b7d2 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Action: 'create', calling method: .version_select at 0x7f1382728700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1562383898", "metadata": {"Type": "work"}}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:21.355286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-05b0b9c3-44dc-492d-94a3-1f315609b7d2 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.356221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-05b0b9c3-44dc-492d-94a3-1f315609b7d2 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006617 Apr 05 11:35:21.360941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 91/209] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Apr 5 11:35:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:35:21.366392 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f6ca7bcf-ce6e-4c0e-9a5a-289b959ca492 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Action: 'create', calling method: .version_select at 0x7f1382ed2e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-624750946", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:21.369167 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f6ca7bcf-ce6e-4c0e-9a5a-289b959ca492 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.369167 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f6ca7bcf-ce6e-4c0e-9a5a-289b959ca492 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006504 Apr 05 11:35:21.369863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 119/210] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Apr 5 11:35:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:35:21.391221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-939074c3-3902-4142-9df2-8d85ba1b569d tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Calling method '.version_select at 0x7f13827389d0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:21.433542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-939074c3-3902-4142-9df2-8d85ba1b569d tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] HTTP exception thrown: Volume tempest-invalid-998749569 could not be found. Apr 05 11:35:21.434143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-939074c3-3902-4142-9df2-8d85ba1b569d tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 404 to user: Volume tempest-invalid-998749569 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.435927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-939074c3-3902-4142-9df2-8d85ba1b569d tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-998749569" status: 404 len: 98 microversion: 2.1 time: 0.047557 Apr 05 11:35:21.447142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e5d76f1a-b6c5-4a1d-84e6-0573a65d4365 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004707 Apr 05 11:35:21.447716 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 120/211] 10.222.0.60 () {58 vars in 1139 bytes} [Tue Apr 5 11:35:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 05 11:35:21.447986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 92/212] 10.222.0.60 () {58 vars in 1214 bytes} [Tue Apr 5 11:35:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-998749569 => generated 98 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:35:21.459863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-808cd22e-7916-46af-91a5-cd0b6139725c tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005069 Apr 05 11:35:21.460647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 121/213] 10.222.0.60 () {58 vars in 1136 bytes} [Tue Apr 5 11:35:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 11:35:21.475007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-725432eb-b290-488a-9222-0c74d5a5ad37 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Calling method '.version_select at 0x7f1382738ca0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:21.516493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-725432eb-b290-488a-9222-0c74d5a5ad37 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] HTTP exception thrown: Volume 1a6dc922-f813-45cc-bebe-00ded5cb73f1 could not be found. Apr 05 11:35:21.517100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-725432eb-b290-488a-9222-0c74d5a5ad37 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 404 to user: Volume 1a6dc922-f813-45cc-bebe-00ded5cb73f1 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.518144 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-725432eb-b290-488a-9222-0c74d5a5ad37 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1a6dc922-f813-45cc-bebe-00ded5cb73f1" status: 404 len: 109 microversion: 2.1 time: 0.047847 Apr 05 11:35:21.518681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 93/214] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:35:21 2022] DELETE /compute/v2.1/os-volumes/1a6dc922-f813-45cc-bebe-00ded5cb73f1 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:35:21.528247 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25788c0a-d3ba-4975-8ef3-140d62a32854 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Calling method '.version_select at 0x7f1382f23040>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:21.573685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-25788c0a-d3ba-4975-8ef3-140d62a32854 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] HTTP exception thrown: Volume 51750593-8b26-4e03-942c-1eb807e1cea0 could not be found. Apr 05 11:35:21.574287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25788c0a-d3ba-4975-8ef3-140d62a32854 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] Returning 404 to user: Volume 51750593-8b26-4e03-942c-1eb807e1cea0 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:35:21.575114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-25788c0a-d3ba-4975-8ef3-140d62a32854 tempest-VolumesNegativeTest-1978138855 tempest-VolumesNegativeTest-1978138855-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/51750593-8b26-4e03-942c-1eb807e1cea0" status: 404 len: 109 microversion: 2.1 time: 0.050917 Apr 05 11:35:21.575689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 122/215] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:35:21 2022] GET /compute/v2.1/os-volumes/51750593-8b26-4e03-942c-1eb807e1cea0 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:35:21.946308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:21.948860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:21.974704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:21.975176 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:21.976026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:21.976471 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:22.382832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:22.392472 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-197f50f5-baa3-4786-b367-d0cdb4c30715 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.451340 Apr 05 11:35:22.403625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 94/216] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:21 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:23.410812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:23.412555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:23.420353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:23.425632 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:23.426550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:23.427004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:23.705626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:23.724512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3500082d-4b29-4da6-be61-74abf41f0467 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.317803 Apr 05 11:35:23.726355 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 123/217] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:23 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:24.742928 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:24.744133 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:24.750728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:24.751393 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:24.752415 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:24.753052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:25.042287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:25.053274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7e3bf97f-1ae0-4357-8ecb-18bb9247e1b1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.314187 Apr 05 11:35:25.055732 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 95/218] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:24 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:26.073766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:26.078855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:26.087813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:26.089781 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:26.092655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:26.093133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:26.352775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:26.361026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e4f4def9-ac33-4fff-918c-c837374dab0c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.292315 Apr 05 11:35:26.372939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 124/219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:26 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:26.894969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Action: 'create', calling method: .version_select at 0x7f1382738940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2035940498"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:26.908653 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for project 8499ce2abe10411589e913912a8c40ed. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:35:26.913469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for user dae94e637c714c90a660f824b42c8fd3 and project 8499ce2abe10411589e913912a8c40ed. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:35:27.204932 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for project 8499ce2abe10411589e913912a8c40ed. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:35:27.209667 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for user dae94e637c714c90a660f824b42c8fd3 and project 8499ce2abe10411589e913912a8c40ed. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:35:27.222751 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-06876e77-7bcd-4c5f-97d4-2a36ee4a5317 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.525764 Apr 05 11:35:27.223353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 96/220] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:35:26 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:27.382140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:27.382815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:27.389135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:27.389583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:27.390395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:27.390932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:27.568182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:27.575474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b20f0a36-e600-4b3a-a979-d31c701bd5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.199096 Apr 05 11:35:27.581503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 125/221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:27 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:28.593858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:28.594469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:28.602017 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:28.602665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:28.603461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:28.604034 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:28.770644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:28.776475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e54b56cd-0693-44a1-ae7d-7b5d70598ba2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.187184 Apr 05 11:35:28.777186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 97/222] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:28 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:29.794081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:29.795341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:29.808959 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:29.809776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:29.811448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:29.813678 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:30.048490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:30.058842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5e2a340a-b669-42a0-838e-727df804dc85 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.268499 Apr 05 11:35:30.069800 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 126/223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:29 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:30.230634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:30.231159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:30.237508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:30.237973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:30.238835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:30.239270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:30.262796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-09ce40b3-8ce4-468b-b64c-a0bdaa2d12c5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/ips" status: 200 len: 145 microversion: 2.1 time: 0.036095 Apr 05 11:35:30.263739 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 98/224] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:35:30 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:35:31.079986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:31.083159 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:31.090450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:31.090976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:31.091875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:31.092390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:31.285943 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:31.296310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f13a35b1-1658-4982-83f8-8ea29d997200 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.223896 Apr 05 11:35:31.307884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 127/225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:31 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:32.090600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:32.091148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:32.097043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:32.097643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:32.098356 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:32.098789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:32.122954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-45d4dfa0-e04e-40fc-8757-71c1b8269d30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036520 Apr 05 11:35:32.123758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 99/226] 10.222.0.60 () {60 vars in 1288 bytes} [Tue Apr 5 11:35:32 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:35:32.317143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:32.317754 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:32.323708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:32.324160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:32.324966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:32.325398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:32.492120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:32.499543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-626547cd-563e-42fa-afd2-f9fb4f85e73b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.187068 Apr 05 11:35:32.500252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 128/227] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:32 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:33.519906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:33.523669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:33.531162 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:33.531728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:33.532725 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:33.533277 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:33.713783 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:33.722827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-55a241c9-4908-462d-ac83-0b0d1640023a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.209140 Apr 05 11:35:33.723441 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 100/228] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:33 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:34.519879 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79925c00-c404-468e-8751-8670bdd46ae1"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:34.523463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:34.526806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:34.527257 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:34.528065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:34.528503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:34.740407 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:34.741054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:34.748387 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:34.748841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:34.749638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:34.756757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:34.949209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:34.957581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6189f472-3e08-4e15-8cc5-6147e25e9055 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.221246 Apr 05 11:35:34.958319 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 101/229] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:34 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:35.604544 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-30e276fc-a06f-4d52-b818-cc5f818788f2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088677 Apr 05 11:35:35.605270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 129/230] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:35:34 2022] POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:35:35.975132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:35.975775 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:35.992343 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:35.993670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:35.994862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:35.995974 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:36.152287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:36.160811 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d32df21-ae0e-4697-9ab8-c44f97c6cb9f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.189949 Apr 05 11:35:36.162124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 102/231] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:35 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:37.180303 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:37.180995 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:37.187510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:37.187975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:37.188760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:37.189204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:37.351253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:37.351854 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:37.358977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:37.359451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:37.360425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:37.360866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:37.368800 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:37.376464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d18111f3-c03b-4dd5-aec6-2720eab7d6a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.202003 Apr 05 11:35:37.377098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 130/232] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:37 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:37.386818 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lazy-loading 'flavor' on Instance uuid 5f678de2-5855-469b-8c6f-c89816e9b30e {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:35:38.060499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d6435d0f-8631-4ddf-91b0-d07c7fdd3aff tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/action" status: 202 len: 0 microversion: 2.20 time: 0.713607 Apr 05 11:35:38.061342 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 103/233] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Apr 5 11:35:37 2022] POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:35:38.070469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:38.071070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:38.077013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:38.077460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:38.078220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:38.078774 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:38.218110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:38.226785 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:38.228273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:38.229432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ecd0f2f6-2a88-45d7-9be2-18bac5828d0a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.163761 Apr 05 11:35:38.229990 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 131/234] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:38 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:38.398809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:38.400520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:38.407178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:38.407764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:38.408665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:38.409205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:38.571435 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:38.579193 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a379dc28-7cb8-4024-b6ad-3eea91b53746 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.186409 Apr 05 11:35:38.580012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 104/235] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:38 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:39.247717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:39.248316 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:39.263731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:39.263731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:39.263731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:39.263731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:39.424986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:39.434792 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:39.441950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:39.441950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-47e9c347-0841-466e-b331-99f1b9dfa62f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.193626 Apr 05 11:35:39.441950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 132/236] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:39 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:39.596862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:39.598175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:39.604347 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:39.604998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:39.623069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:39.623815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:39.772707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:39.783604 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e2a6cabf-aa00-41b5-9888-e95c21aae2c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.190381 Apr 05 11:35:39.784282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 105/237] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:39 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:40.457976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:40.458569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:40.465502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:40.466164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:40.467133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:40.467961 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:40.646863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:40.654600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:40.656132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:40.657268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0e86eb8-7ed8-47a4-8770-4cf7bdfa94ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.203705 Apr 05 11:35:40.657827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 133/238] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:40 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:40.802466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:40.803273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:40.810241 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:40.810844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:40.811702 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:40.812137 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:40.960888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:40.971131 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b3d9e634-14d9-48a2-bd2b-1269824819ad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.173007 Apr 05 11:35:40.971761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 106/239] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:40 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:41.676378 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:41.676988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:41.684393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:41.684846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:41.685659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:41.686096 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:41.989205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:41.990528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:41.998094 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:41.998946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:41.999990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:42.000576 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:42.062274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:42.071236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:42.072950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:42.074308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d35be300-cc8f-4e09-8912-8bbb3e0d04eb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.402481 Apr 05 11:35:42.074902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 134/240] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:41 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:42.177990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:42.185760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ea05906d-a1cc-4b05-9f7f-227d26b4e72e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.201269 Apr 05 11:35:42.186337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 107/241] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:41 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:43.093807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:43.094407 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:43.101730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:43.102178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:43.102961 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:43.103394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:43.203135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:43.203791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:43.210984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:43.211455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:43.212231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:43.212667 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:43.252653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:43.261961 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:43.263539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:43.264704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-09d90a8a-7ca4-4b78-8a45-365ab81d13bb tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.175102 Apr 05 11:35:43.265266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 135/242] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:43 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:43.354450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:43.363482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-59946a26-f212-4de1-b0ce-b8b171dd84e6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.163830 Apr 05 11:35:43.364350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 108/243] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:43 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:44.282059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:44.282743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:44.289333 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:44.289838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:44.290617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:44.291059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:44.387816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:44.388439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:44.397844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:44.398292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:44.399067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:44.400680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:44.435846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:44.459986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:44.461497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:44.462805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-002eb943-b021-4624-bde4-5f4a917bc6c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.184638 Apr 05 11:35:44.463588 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 136/244] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:44 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:44.558830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:44.566434 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ecfea4c7-bd04-40ef-a896-b375818a8711 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.190762 Apr 05 11:35:44.567002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 109/245] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:44 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:45.481950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:45.482563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:45.488953 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:45.489403 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:45.490176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:45.490621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:45.583655 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:45.584271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:45.590483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:45.590938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:45.591746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:45.592192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:45.627826 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:45.636526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:45.638034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:45.639222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7860c3a1-214d-4408-bf9d-5fd1664006a1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.161116 Apr 05 11:35:45.640340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 137/246] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:45 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:45.741613 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:45.749126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d57bcaf7-1d2c-45bd-abc3-3a8fa74a2260 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.169881 Apr 05 11:35:45.749692 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 110/247] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:45 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:46.641831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b54b99ea-60d8-4c2b-83b0-d581b3e101e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:46.648363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54b99ea-60d8-4c2b-83b0-d581b3e101e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:46.648810 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54b99ea-60d8-4c2b-83b0-d581b3e101e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:46.659903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:46.659903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:46.672916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:46.675759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:46.677748 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:46.678385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:46.729489 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b54b99ea-60d8-4c2b-83b0-d581b3e101e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Going to try to stop instance {{(pid=124242) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 11:35:46.820687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:46.829388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:46.830926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:46.832515 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9f1f0cc9-2eab-4261-8ec8-543476655473 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.178485 Apr 05 11:35:46.833168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 111/248] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:46 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:35:46.838495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:46.839168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:46.879743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:46.879743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:46.879743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:46.879743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:47.071858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:47.071858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2fa06ff3-5cd5-4966-a863-964ec5768726 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.163838 Apr 05 11:35:47.071858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 112/249] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:46 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:47.347463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b54b99ea-60d8-4c2b-83b0-d581b3e101e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action" status: 202 len: 0 microversion: 2.1 time: 0.709053 Apr 05 11:35:47.348283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 138/250] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:35:46 2022] POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:35:47.357341 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:47.358006 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:47.365377 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:47.365830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:47.366618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:47.367052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:47.506804 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:47.515784 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e70f4e4b-461b-4b10-a5bb-a87ce3772be1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.162840 Apr 05 11:35:47.516709 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 113/251] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:47 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:47.852222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:47.852900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:47.859537 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:47.864541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:47.864541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:47.864541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:48.006254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:48.016153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:48.016916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:48.017823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:48.021268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:48.022715 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af19f275-00f8-44a6-8e74-adaa574ecf1f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.175678 Apr 05 11:35:48.023612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 139/252] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:47 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:48.024121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:48.024659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:48.025427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:48.025877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:48.159120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:48.166984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-179d0da5-c982-4824-91cd-15cdc4a1fa9d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.155014 Apr 05 11:35:48.167574 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 114/253] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:48 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:48.537575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:48.538187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:48.545479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:48.545934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:48.546779 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:48.547207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:48.688799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:48.698476 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c90c27c3-03fb-4453-be00-deba4791da37 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.165283 Apr 05 11:35:48.699081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 140/254] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:48 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:49.041503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:49.042112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:49.048479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.048926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.049705 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.051088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.184624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:49.185226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:49.190647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:49.193691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.194148 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.194930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.195369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.199544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:49.201116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:49.202480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7856b7ff-8145-41f4-8022-737bc7fda3d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.164913 Apr 05 11:35:49.203047 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 115/255] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:49 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:49.327641 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:49.335603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-25285f53-ce84-4cd5-b1fe-2b4d3ff183fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.154855 Apr 05 11:35:49.336177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 141/256] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:49 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:49.715627 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:49.716232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:49.723524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.723975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.724734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:49.725195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:49.859013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:49.867067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4be85650-53a8-493e-b679-060802dcb4a0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.155321 Apr 05 11:35:49.867669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 116/257] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:49 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:50.220934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:50.221573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:50.232432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.233555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:50.234744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.235576 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:50.352839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:50.353484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:50.360253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.360943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:50.361877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.363064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:50.383727 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:50.391965 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:50.393497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:50.394667 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9eaa351-6a99-4671-b7a7-11819c5b58ea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.177613 Apr 05 11:35:50.395612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 142/258] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:50 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:50.502860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:50.510128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cc72895d-adc4-43d5-b7d9-0ecd54a5acad tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1522 microversion: 2.1 time: 0.161073 Apr 05 11:35:50.510783 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 117/259] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:50 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:50.888621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:50.888621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:50.890840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.891187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:50.891981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:50.892418 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.027822 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.036922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-319dcc6b-4d0c-4f8e-ad02-23c5c33dd0f9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.156852 Apr 05 11:35:51.037492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 143/260] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:50 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:51.413579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:51.414217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:51.420694 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.421146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.421918 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.422359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.529154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:51.529598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:51.537553 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.538016 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.538908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.539353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.560049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.568491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.569986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.571148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e89fb285-af54-4a71-b7f2-c8a9023903d8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.162309 Apr 05 11:35:51.571733 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 118/261] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:51 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:35:51.677954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.685893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f4e28ca-adb2-4a94-8c97-b664f2d4cd13 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1502 microversion: 2.1 time: 0.162302 Apr 05 11:35:51.686592 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 144/262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:51 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:51.702323 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:51.704602 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:51.709603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.710058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.710826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:51.711258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:51.845607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:51.854111 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d01c132-a028-4f72-a432-87102185844b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1517 microversion: 2.1 time: 0.155570 Apr 05 11:35:51.854682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 119/263] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:51 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:52.054328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:52.054972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:52.060947 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:52.061394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:52.062158 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:52.062840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:52.205942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:52.214098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5421c071-ee5b-45df-951b-74034b24128f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.164032 Apr 05 11:35:52.214746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 145/264] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:52 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:52.590147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:52.590749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:52.597781 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:52.598328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:52.598946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:52.599380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:52.754386 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:52.762100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:52.763649 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:52.764801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-93f6137a-e737-445e-8af3-e8af1ec3f444 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.178595 Apr 05 11:35:52.765366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 120/265] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:52 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:53.233606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:53.234386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:53.241224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:53.241808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:53.242796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:53.243355 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:53.427691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:53.435873 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5040bcb-e6b7-4b35-9ef6-a6544e56f9dd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.206011 Apr 05 11:35:53.436445 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 146/266] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:53 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:53.784208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:53.784208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:53.790449 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:53.790906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:53.791711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:53.792149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:53.988350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:53.996482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:53.998035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:53.999191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e2f974b9-75d5-4d01-b119-68e00556c9df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.219875 Apr 05 11:35:53.999787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 121/267] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:53 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:54.453792 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:54.454528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:54.461486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:54.461939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:54.462705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:54.463141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:54.602084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:54.608041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-654de818-2bd7-4d71-bbd8-9677f7b05a98 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.158050 Apr 05 11:35:54.608851 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 147/268] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:54 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:55.017920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:55.019061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:55.025588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:55.026093 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:55.026853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:55.027285 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:55.167232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:55.179668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:55.181303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:55.184294 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bb26cbed-62da-4bdb-81d3-cd5c2b42c285 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.170419 Apr 05 11:35:55.184871 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 122/269] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:55 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:55.625853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:55.626454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:55.633549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:55.634006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:55.634781 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:55.635223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:55.776646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:55.782070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29880799-fefd-4700-a149-b2dd6f9410d5 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.160109 Apr 05 11:35:55.782844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 148/270] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:55 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:56.215258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:56.217092 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:56.227230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.228077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:56.228856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.229305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:56.483461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:56.493455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:56.495024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:56.496305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1e039abb-76f5-4c57-940a-3e599b39a676 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.287210 Apr 05 11:35:56.497054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 123/271] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:56 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:56.800133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:56.801642 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:56.808094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.808541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:56.809304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.809936 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:56.980179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:56.981205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:56.987648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.988359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:56.989136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:56.989778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.009608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:57.018029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'flavor' on Instance uuid 22f8790e-86d5-4392-8b87-74f29cb57aa1 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:35:57.018198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eb69bd2c-4d15-400e-a9a0-496f7cb5de63 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.221964 Apr 05 11:35:57.018198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 149/272] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:56 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:57.139558 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1983018729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2035940498", "security_groups": [{"name": "tempest-secgroup-smoke-1919320117"}], "networks": [{"uuid": "b762bdc2-8c69-4463-a0a9-b6a9592c01ff"}], "block_device_mapping_v2": [{"uuid": "fdd3e685-26da-4f00-a7ed-d47baa11de87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:35:57.266299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] validate_networks() for [('b762bdc2-8c69-4463-a0a9-b6a9592c01ff', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:35:57.445491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c18a810a-8401-40da-a1ae-9a752a0fce96 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/action" status: 200 len: 32 microversion: 2.1 time: 0.469280 Apr 05 11:35:57.446211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 124/273] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:35:56 2022] POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/action => generated 32 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:35:57.455538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:57.456591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:57.463052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.463796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.464740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.465336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.677645 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:57.688793 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f77793d3-ac6f-40b2-9703-e2b8fc39ba64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.237243 Apr 05 11:35:57.690908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 125/274] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:57 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:57.696221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:57.696833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:57.704120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.704831 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.710313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.710852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.826471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:35:57.826895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:35:57.830665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:35:57.830665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:35:57.831655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:35:57.841615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.842076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.843018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:57.843484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:57.879624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for project 8499ce2abe10411589e913912a8c40ed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:35:57.887464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Getting quotas for user dae94e637c714c90a660f824b42c8fd3 and project 8499ce2abe10411589e913912a8c40ed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:35:57.932062 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:57.938619 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:57.941888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:57.945743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bff1ad54-3209-4998-beec-b83f35876038 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.251979 Apr 05 11:35:57.946558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 126/275] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:57 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:35:58.040032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:58.040548 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:58.046628 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.047136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:58.047971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.048409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:58.224877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:35:58.228355 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdd3e685-26da-4f00-a7ed-d47baa11de87',volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:35:58.380597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:58.389967 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fd82a946-39d2-40bd-9013-5420483183e9 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.354202 Apr 05 11:35:58.391942 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 127/276] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:58 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:58.708504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:58.709172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:58.715155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.715620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:58.716382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.716816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:58.861023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:58.869334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a1615140-f137-4fb6-b416-1caf69243ff5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.164765 Apr 05 11:35:58.869907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 128/277] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:58 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:58.965077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:58.965685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:58.972324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.972788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:58.973550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:58.973986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:59.111095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:59.119289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:59.120815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:59.121960 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-64d96e04-f8f5-410e-8a3c-0e25b4dda0f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.161026 Apr 05 11:35:59.122515 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 129/278] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:35:58 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:35:59.254354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d363975e-73f9-4c20-9c9f-8aa7f62a4624 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.118534 Apr 05 11:35:59.259767 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 150/279] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:35:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:35:59.269480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0739df23-df21-4914-b6de-6955a8fdc9c9 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:59.269480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0739df23-df21-4914-b6de-6955a8fdc9c9 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:59.328099 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0739df23-df21-4914-b6de-6955a8fdc9c9 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:59.336013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0739df23-df21-4914-b6de-6955a8fdc9c9 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1089 microversion: 2.1 time: 0.074953 Apr 05 11:35:59.336853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 130/280] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:59 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:35:59.409399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:59.410794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:59.417956 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:59.418511 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:59.419375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:59.420037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:59.552089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:35:59.559808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e0f657c-f39e-45d3-8bd8-a6039c4dcbd6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.154894 Apr 05 11:35:59.560374 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 151/281] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:59 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:35:59.885954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:35:59.886588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:35:59.892726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:59.893668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:35:59.894475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:35:59.894908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:00.027199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.035579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f27de3e1-60d1-4bcc-8173-09a4d81addd4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.153190 Apr 05 11:36:00.036132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 131/282] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:35:59 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:00.140824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:00.141364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:00.147911 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:00.148620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:00.149180 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:00.149619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:00.310839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.319975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.321483 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.323081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d013a3f-0039-403b-8054-47f9900a213e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.186455 Apr 05 11:36:00.323827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 152/283] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:00 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:00.357111 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9e2b0de0-c056-4032-be04-fadfdace3db1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:00.357721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9e2b0de0-c056-4032-be04-fadfdace3db1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:00.422820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9e2b0de0-c056-4032-be04-fadfdace3db1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.430132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9e2b0de0-c056-4032-be04-fadfdace3db1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1089 microversion: 2.1 time: 0.076973 Apr 05 11:36:00.430701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 132/284] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:00 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:00.577940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:00.578562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:00.585464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:00.585917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:00.587114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:00.587619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:00.725505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:00.733863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-361bd4b2-d556-4e4b-a60a-81b27bd724a6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.160186 Apr 05 11:36:00.734444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 153/285] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:00 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:01.059873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:01.060633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:01.067251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.067737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.068509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.068944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.208417 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.215851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c4875ea5-1fc7-4d03-b0a6-4096d78e01e7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.159776 Apr 05 11:36:01.220566 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 133/286] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:01 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:01.345145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:01.345764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:01.352563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.353027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.353806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.354245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.446953 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:01.447708 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:01.453939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.454453 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.455173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.455866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.496964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.503528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.505050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.506307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-578a5075-69e8-476f-a8a0-16e661a39af7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1743 microversion: 2.20 time: 0.165155 Apr 05 11:36:01.506936 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 154/287] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:01 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:01.514541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.522423 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1a090043-578c-4d85-adf7-25c5be4a0f0c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1131 microversion: 2.1 time: 0.079366 Apr 05 11:36:01.522996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 134/288] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:01 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1131 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:01.750747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:01.758289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:01.758289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.758289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.758861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:01.759293 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:01.894673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:01.902559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9159f112-dc8a-47ea-8b6c-4d9a7f8f12c2 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.155759 Apr 05 11:36:01.903133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 155/289] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:01 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:02.234261 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:02.234261 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:02.240070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.240529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.241306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.241752 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.386166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:02.395206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3a2f9389-2361-4212-bdca-9761fbad642f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.165052 Apr 05 11:36:02.395816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 135/290] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:02 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:02.526565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:02.527744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:02.540412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:02.541178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:02.545202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.545850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.546790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.547372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.549509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.550032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.550815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.551255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.648057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:02.658747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-122ad40a-2ced-47fc-81df-b725ebb9468b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1195 microversion: 2.1 time: 0.122109 Apr 05 11:36:02.659576 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 136/291] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:02 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1195 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:02.728317 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:02.736397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:02.739199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:02.740464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9cfa5494-218c-45d2-82a6-e01676aa665a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1743 microversion: 2.20 time: 0.218581 Apr 05 11:36:02.741011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 156/292] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:02 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:02.920895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:02.921516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:02.928883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.930988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:02.930988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:02.930988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.183937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:03.194072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6744c587-b01b-4474-b7f3-147611b31a30 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.277585 Apr 05 11:36:03.194757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 137/293] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:02 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:03.412784 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:03.413578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:03.419636 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.420084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.427098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.427098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.575224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:03.584263 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42b44e17-d328-4afd-8736-aee341c04f50 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.175426 Apr 05 11:36:03.600799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 157/294] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:03 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:03.683541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:03.685157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:03.694274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.694737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.695560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.696145 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.761230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:03.761230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:03.778719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.779039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:03.785594 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:03.786070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:04.048552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.058041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.060069 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.061356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18bd3e5e-1df5-49ec-8b26-955966b049d3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.306688 Apr 05 11:36:04.063474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 158/295] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:03 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:04.109464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.132929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-58c736d4-a2f0-49c1-b946-6f9a094b2746 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1273 microversion: 2.1 time: 0.453526 Apr 05 11:36:04.135890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 138/296] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:03 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:04.213810 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:04.214652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:04.228238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:04.228972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:04.232401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:04.233121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:04.395328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.403181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-07dbfaa8-b14a-4630-862c-11b19d5412e4 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.195104 Apr 05 11:36:04.403790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 159/297] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:04 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:04.603089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:04.606590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:04.619051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:04.624008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:04.625528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:04.627997 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:04.862450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:04.873546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8e297ce9-86b7-4c11-a728-36a8af98cbcd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.276601 Apr 05 11:36:04.884259 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 139/298] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:04 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:04.963005 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-60c69855-cadc-4227-bef9-e81e686fad9d req-6d76b153-3a95-4d7c-8edf-0dbdf110a9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:04.973328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-60c69855-cadc-4227-bef9-e81e686fad9d req-6d76b153-3a95-4d7c-8edf-0dbdf110a9e8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:04.979182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-60c69855-cadc-4227-bef9-e81e686fad9d req-6d76b153-3a95-4d7c-8edf-0dbdf110a9e8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.010284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-60c69855-cadc-4227-bef9-e81e686fad9d req-6d76b153-3a95-4d7c-8edf-0dbdf110a9e8 service nova] Creating event network-changed:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:36:05.012041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-60c69855-cadc-4227-bef9-e81e686fad9d req-6d76b153-3a95-4d7c-8edf-0dbdf110a9e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053626 Apr 05 11:36:05.012661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 160/299] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:05.090478 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:05.091090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:05.098476 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.099576 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.100264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.102338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.162939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:05.164224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:05.180578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.181075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.182358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.182802 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.376594 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:05.385830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-86f9c754-e128-4289-9729-5661e936a2d0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1273 microversion: 2.1 time: 0.228576 Apr 05 11:36:05.386331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 161/300] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:05 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:05.422561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:05.423452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:05.431322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.432181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.433136 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.433725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.634073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:05.640100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:05.640930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:05.642510 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:05.647946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7c54626a-96ab-41b1-a63a-af5d025fa419 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.562442 Apr 05 11:36:05.648529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 140/301] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:05 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:05.651845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bcbc3fb0-6d7d-407f-b5de-c873a10773f3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.233064 Apr 05 11:36:05.653080 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 162/302] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:05 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:05.741648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-7abe6f01-de4b-4c1a-a019-8c3042866d09 req-ff7c5567-d7d2-4bad-8abf-bde7f7682cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "name": "network-vif-plugged", "status": "completed", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:05.754611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-7abe6f01-de4b-4c1a-a019-8c3042866d09 req-ff7c5567-d7d2-4bad-8abf-bde7f7682cef service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.755055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-7abe6f01-de4b-4c1a-a019-8c3042866d09 req-ff7c5567-d7d2-4bad-8abf-bde7f7682cef service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.769824 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-7abe6f01-de4b-4c1a-a019-8c3042866d09 req-ff7c5567-d7d2-4bad-8abf-bde7f7682cef service nova] Creating event network-vif-plugged:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:36:05.778527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-7abe6f01-de4b-4c1a-a019-8c3042866d09 req-ff7c5567-d7d2-4bad-8abf-bde7f7682cef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041493 Apr 05 11:36:05.779198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 141/303] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:05.893760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:05.895193 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:05.904410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.907670 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:05.910606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:05.911241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.257265 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:06.265491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1b336b96-169c-4ad6-b242-2f53ddd4aa48 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.375953 Apr 05 11:36:06.266072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 163/304] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:05 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:06.403677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:06.404280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:06.412560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.413288 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.414248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.414828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.676786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:06.677443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:06.683842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.684476 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.685413 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.686014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.899549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:06.914452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9bffe383-8b5d-48f9-b147-a1f4533b2f9b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.241771 Apr 05 11:36:06.915922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 164/305] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:06 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:06.921745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:06.923504 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:06.933099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.933770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:06.974132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:06.974132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:07.122020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:07.135788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-da45f321-abdc-42c4-b271-522796ab3c47 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.736176 Apr 05 11:36:07.136808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 142/306] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:06 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:07.282653 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:07.283602 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:07.290795 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:07.291752 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:07.292957 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:07.293618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:07.317457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:07.335647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:07.339870 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:07.342187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8add3b8c-738b-4da2-a8a5-802ab7295349 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.425050 Apr 05 11:36:07.343551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 165/307] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:06 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:07.548047 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:07.567399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0cb700b1-9144-4c5d-aba9-c3afa326a21a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.288395 Apr 05 11:36:07.569442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 143/308] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:07 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:07.932975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:07.956077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:07.969881 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:07.970807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:07.972999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:07.973686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.154836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:08.156067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:08.170719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.175528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.175528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.175528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.242508 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.253219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d104842c-cb37-4217-a7fd-806219e16f56 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.324801 Apr 05 11:36:08.260253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 166/309] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:07 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:08.364092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:08.365761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:08.372825 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.373855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.374963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.375962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.466035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.488584 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bd9cc1bd-98a3-442c-b380-97c48ffe0cf0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.337065 Apr 05 11:36:08.494140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 144/310] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:08 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:08.586253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:08.588123 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:08.595400 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.599979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.605436 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.605436 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:08.605436 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:08.611254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.614498 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.615981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-59c2064e-f153-46f4-8859-6a2e2fdbc950 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.258684 Apr 05 11:36:08.617064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 167/311] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:08 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:08.892474 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:08.907603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ec3ce373-fac4-4aee-9103-04a5179ef51a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.326781 Apr 05 11:36:08.910023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 145/312] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:08 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:09.277174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:09.277984 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:09.285279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.285945 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.286903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.287524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.524385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:09.524912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:09.552103 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.552731 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.553599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.554108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.554222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:09.565143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c1a9faa-179d-4b69-a328-c1312d33604d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.291753 Apr 05 11:36:09.574801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 168/313] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:09 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:09.692545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:09.692545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:09.696208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.696730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.697738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.698343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.903002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:09.915887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:09.919811 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:09.921547 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2965cf8-f33a-4387-b155-ecda3c33f1e3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.251430 Apr 05 11:36:09.922887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 169/314] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:09 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:09.951854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:09.952521 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:09.964058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.964565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.965395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:09.967682 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:09.980132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:09.990891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-11c06177-375c-44d4-810c-9016dd72b6f1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.477989 Apr 05 11:36:09.992016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 146/315] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:09 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:10.153121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:10.166213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b39becba-1e8c-4199-983a-fa4aa2d61da8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.229932 Apr 05 11:36:10.168370 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 170/316] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:09 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:10.583311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:10.583311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:10.592030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:10.592782 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:10.594375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:10.595069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:10.941275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:10.941901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:10.951975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:10.952431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:10.956049 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:10.956049 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:11.014492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.024703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0f1b5218-e87e-49d2-a746-e4c6a8e1184b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.446280 Apr 05 11:36:11.025300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 147/317] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:10 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:11.043745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:11.057574 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:11.077419 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:11.083567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:11.087174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:11.090406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:11.269184 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.280620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.282660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.286195 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9039b2ec-bd2b-4edb-997f-491f1cd0c434 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.349101 Apr 05 11:36:11.301199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 171/318] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:10 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:11.308426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:11.309891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:11.321529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:11.322453 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:11.323663 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:11.324960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:11.518310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.527579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-629cb855-0260-4bcf-98f0-e7c5f9ca7fb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.224531 Apr 05 11:36:11.529912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 172/319] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:11 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:11.680491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:11.688802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-83522753-3ebc-48db-b900-421419bcb0f8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.662473 Apr 05 11:36:11.691505 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 148/320] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:11 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:12.042163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:12.042763 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:12.049828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.050286 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.051076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.051544 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.305665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:12.313825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:12.317550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.318283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.319657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.320494 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.431188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:12.441016 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae5bebe2-1437-4933-9faa-5fa6122b9d3d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.402683 Apr 05 11:36:12.454262 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 173/321] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:12 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:12.553790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:12.553790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:12.578163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.578803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.579654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.582645 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.896455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:12.904769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4f766a21-e93f-47e5-acfd-f9f5cb178978 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.362474 Apr 05 11:36:12.908103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 174/322] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:12 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:12.916274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:12.919175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:12.927160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.930972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:12.934460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:12.935918 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:13.205001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:13.219807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50ac1e5b-1568-49a0-99b9-c8d693391e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.308860 Apr 05 11:36:13.225176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 175/323] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:12 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:13.263104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:13.271806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:13.274173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:13.275587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-038531d0-590e-48e8-b110-4adb96c482bf tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.974405 Apr 05 11:36:13.276531 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 149/324] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:12 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:13.461446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:13.462240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:13.477504 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:13.479046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:13.480681 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:13.482274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:13.741131 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:13.754580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f4d2e68c-2009-458b-8326-0a7ab92b562d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.297494 Apr 05 11:36:13.759213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 176/325] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:13 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:13.926085 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:13.926707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:13.934609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:13.935578 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:13.937065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:13.937767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.241293 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:14.242017 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:14.254119 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.254669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.255747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.256295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.258951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:14.272804 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e7fd6b4a-89d7-46c3-9650-bfa50aefa138 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.351497 Apr 05 11:36:14.274493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 150/326] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:13 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:14.318563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:14.319692 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:14.334040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.337355 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.338534 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.340211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.578462 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:14.586612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b57a0aaa-3d4e-495b-9848-3e2dc6754e7e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.349248 Apr 05 11:36:14.597445 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 177/327] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:14 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:14.610411 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:14.611121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:14.630473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.631249 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.632319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.632934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.678477 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd4dd0cb-f46a-4fff-b6db-8a77d3830060 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/ips" status: 200 len: 149 microversion: 2.1 time: 0.073844 Apr 05 11:36:14.679388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 178/328] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:36:14 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/ips => generated 149 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:14.697757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:14.714362 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:14.717679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:14.721450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d5899d2a-3962-438b-a053-b31c2d4f0315 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.421542 Apr 05 11:36:14.722923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 151/329] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:14 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:14.775132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:14.775782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:14.781786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.788529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:14.789419 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:14.790196 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.178765 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:15.193182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-06d7aa6e-4c2a-4a06-b9fd-39e6eb492146 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.421896 Apr 05 11:36:15.197093 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 179/330] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:14 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:15.296019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:15.296019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:15.308697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.309749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.311105 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.311777 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.605535 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:15.606236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:15.627182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.630514 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.631538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.632001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.838615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:15.846539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bb5af519-3bb9-4c5b-9333-deb96749a1f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.556466 Apr 05 11:36:15.847145 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 152/331] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:15 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:15.871839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:15.872459 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:15.897987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.898506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:15.899228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:15.932601 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:16.122891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:16.140164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-283527dd-790e-442e-83ec-6253ee487392 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.539680 Apr 05 11:36:16.142369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 180/332] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:15 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:16.214197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:16.215092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:16.228213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:16.229154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:16.230152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:16.233268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:16.563160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:16.572391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-974bc058-9b3f-413f-a243-e88a1b948043 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.362176 Apr 05 11:36:16.572977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 181/333] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:16 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:16.583311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:16.592075 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:16.593839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:16.595232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dec9f4df-93dd-484a-b062-157cc788e19f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.747079 Apr 05 11:36:16.596558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 153/334] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:15 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:16.863351 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:16.863942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:16.870183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:16.870629 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:16.871400 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:16.871860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.008612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:17.043067 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d595c2c-6367-440f-b303-5cce2a55d84f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.184007 Apr 05 11:36:17.043668 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 182/335] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:16 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:17.161405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:17.162029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:17.179317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.185055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.185055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.185055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.397551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:17.423045 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d5064734-8ed7-437c-8982-833d76461e2e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.267226 Apr 05 11:36:17.425199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 154/336] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:17 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:17.597983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:17.598389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:17.616121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.616569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.617346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.624672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:17.625918 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:17.636717 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.639543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.645712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:17.647921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:17.648572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.068200 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:18.076748 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b6594403-9fe6-456e-bc1f-e97b07f1e725 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1699 microversion: 2.1 time: 0.490352 Apr 05 11:36:18.079031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 183/337] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:17 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1699 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:18.085718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:18.086685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:18.094853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.096213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.097447 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.098050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.122764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:18.133284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:18.135512 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:18.139182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dc7ebce6-2c28-4e53-90b9-af63b2678c3d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.517885 Apr 05 11:36:18.141828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 155/338] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:17 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:18.148354 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-245a47af-e70b-47a2-bc47-f5d5dff3d2c8 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:18.179970 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-245a47af-e70b-47a2-bc47-f5d5dff3d2c8 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.180561 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-245a47af-e70b-47a2-bc47-f5d5dff3d2c8 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.362163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-245a47af-e70b-47a2-bc47-f5d5dff3d2c8 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Going to try to start instance {{(pid=124243) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 11:36:18.401129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:18.414992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-41986384-2065-4417-a516-63bda1d4c51e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.334258 Apr 05 11:36:18.415636 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 184/339] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:18 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:18.429746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:18.431737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:18.452632 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.453084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.455464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.456635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.691508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-245a47af-e70b-47a2-bc47-f5d5dff3d2c8 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action" status: 202 len: 0 microversion: 2.1 time: 0.546771 Apr 05 11:36:18.692449 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 156/340] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:36:18 2022] POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:36:18.702915 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:18.718349 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:18.739861 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.740641 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:18.741629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:18.743720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.065023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:19.074481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-709918bf-52d3-4b0e-95c3-a857c4328cd1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.380662 Apr 05 11:36:19.076267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 157/341] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:18 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:19.088729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:19.089599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:19.099735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.100366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.101301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.101890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.506875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:19.519583 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-36032cb0-ad41-48d7-836f-38e150ccd036 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1708 microversion: 2.1 time: 0.441713 Apr 05 11:36:19.520910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 158/342] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:19 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1708 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:19.526342 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:19.527030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:19.537855 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.542556 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.546554 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.550967 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.775376 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a029ae81-c9b6-4d31-8be2-44a8a06ca99a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.358422 Apr 05 11:36:19.777185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 185/343] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:36:18 2022] POST /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments => generated 194 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:19.785819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:19.793319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:19.802699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.803562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.810953 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:19.811792 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:19.891008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:19.903025 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:19.908350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:19.908350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e16fefdd-e270-4498-847c-8d86a40c615c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.384218 Apr 05 11:36:19.908350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 159/344] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:19 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:20.093209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:20.094366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:20.102212 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.108462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.108462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.108462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.368946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:20.378655 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-06d8e234-b6f0-42c9-abfe-e3baf74b499f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.290307 Apr 05 11:36:20.388198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 160/345] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:20 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:20.388198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-1345f86e-f276-4b3e-a6bd-739b146b2bc3 req-a550f435-5bfe-48a3-bd4c-d2a8a3392068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "name": "network-vif-plugged", "status": "completed", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:20.407777 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1345f86e-f276-4b3e-a6bd-739b146b2bc3 req-a550f435-5bfe-48a3-bd4c-d2a8a3392068 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.409996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1345f86e-f276-4b3e-a6bd-739b146b2bc3 req-a550f435-5bfe-48a3-bd4c-d2a8a3392068 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.448908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-1345f86e-f276-4b3e-a6bd-739b146b2bc3 req-a550f435-5bfe-48a3-bd4c-d2a8a3392068 service nova] Creating event network-vif-plugged:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:36:20.469372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-1345f86e-f276-4b3e-a6bd-739b146b2bc3 req-a550f435-5bfe-48a3-bd4c-d2a8a3392068 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088250 Apr 05 11:36:20.469943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 161/346] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:20.538721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:20.539462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:20.558427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.558427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.558427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.558427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.807210 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:20.820882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-55eef4ac-a4e5-49f4-88d0-9d0656ff2bfb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1708 microversion: 2.1 time: 0.286930 Apr 05 11:36:20.843570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 162/347] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:20 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:20.868392 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:20.881494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c332d71-fedb-461c-a5f6-acd7c5de9cb9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1503 microversion: 2.1 time: 1.102772 Apr 05 11:36:20.882570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 186/348] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:19 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1503 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:20.900663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08ee8fa8-b291-47af-b86d-5714f9050e70"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:20.902724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:20.910378 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.911095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.912364 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.913081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.932329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:20.933583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:20.944120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.948117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:20.949223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:20.949860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.006286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] HTTP exception thrown: Cannot 'attach_volume' instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 while it is in vm_state rescued Apr 05 11:36:21.008625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Returning 409 to user: Cannot 'attach_volume' instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 while it is in vm_state rescued {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:36:21.009731 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0c04e691-0d15-4f03-bbad-3434ba7e367f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114488 Apr 05 11:36:21.015712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 163/349] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:36:20 2022] POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 05 11:36:21.028951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:21.030885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:21.045291 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.046596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.047540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.048154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.352662 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:21.378510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:21.380476 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:21.386396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d52109b3-236a-4a87-b330-a4de59f84d4c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.465232 Apr 05 11:36:21.396292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 187/350] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:20 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:21.402928 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:21.404895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:21.419528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.423260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-775c0199-05ee-45e6-ad0e-9a4f474d911f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.405337 Apr 05 11:36:21.424325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.425478 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.426142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.427914 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 164/351] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:36:21 2022] POST /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:36:21.436649 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:21.437365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:21.445723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.446385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.454302 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.454302 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.750304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:21.754340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:21.776307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-68a4fe84-908f-4dad-a533-c3f9e09b8ecd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.364175 Apr 05 11:36:21.777755 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c64a654d-82fc-47aa-91eb-9b9ce768fc61 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1511 microversion: 2.1 time: 0.348009 Apr 05 11:36:21.778348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 188/352] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:21 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:21.798216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 165/353] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:21 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:21.840348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:21.840971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:21.847387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.848022 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:21.848936 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:21.849389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.278094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:22.295505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9bb731a1-70e9-4550-967f-1cd4c9fbbaee tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1712 microversion: 2.1 time: 0.459110 Apr 05 11:36:22.308832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 189/354] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:21 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1712 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:22.406653 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:22.407461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:22.421470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.421930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.422730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.423173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.756363 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:22.768882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:22.772083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:22.776608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-09bad9a2-f5b1-489b-b972-40e9ee94f459 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.374424 Apr 05 11:36:22.779112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 166/355] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:22 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:22.794519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:22.795561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:22.802656 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:22.803286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:22.806331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.812026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.815524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.820597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.822180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.822452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:22.822730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:22.823516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:23.139076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:23.149262 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7d132c5e-c6f1-44e2-bb35-372572aec74c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.358246 Apr 05 11:36:23.150565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 190/356] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:22 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:23.248633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:23.266367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6ddab5d1-e365-4982-9a5c-ed3e89bc4469 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1511 microversion: 2.1 time: 0.469411 Apr 05 11:36:23.272299 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 167/357] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:22 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:23.805534 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:23.806706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:23.825774 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:23.826388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:23.827307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:23.827876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:24.038212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:24.055725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:24.057480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:24.058867 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05330c78-a237-41a9-ab5a-cbee2acc7c1d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.257822 Apr 05 11:36:24.071915 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 191/358] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:23 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:24.166453 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:24.166954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:24.174300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:24.174753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:24.175607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:24.176042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:24.284897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:24.285527 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:24.291768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:24.292221 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:24.292997 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:24.293434 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:24.328439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:24.340538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5ff79557-9d3e-461f-a23d-a21acea3d5ba tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1261 microversion: 2.1 time: 0.174323 Apr 05 11:36:24.340538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 168/359] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:24 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:24.614889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:24.636712 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b2be04e8-d33b-475d-99da-458c2d2a7cde tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1511 microversion: 2.1 time: 0.356315 Apr 05 11:36:24.647789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 192/360] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:24 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:25.078266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:25.078958 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:25.087324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.089827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.091672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.092421 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.321300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:25.347720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:25.347720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:25.347720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9ad8b1f0-79b1-40b7-bd7c-48f9b8a66971 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.261855 Apr 05 11:36:25.350387 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 169/361] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:25 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:25.358199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:25.358819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:25.368762 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.369458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.370390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.370997 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.569744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:25.577111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98c43d47-42b7-464e-b814-e95527d5e5bd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1445 microversion: 2.1 time: 0.224386 Apr 05 11:36:25.577681 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 193/362] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:25 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1445 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:25.604293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:25.604907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:25.611217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.611784 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.612572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.613008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.655254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:25.656223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:25.662950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.663439 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.664223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:25.664663 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:25.943858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:25.951593 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e5f9501-da39-4681-81b7-81f482dd1c49 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1511 microversion: 2.1 time: 0.301280 Apr 05 11:36:25.959859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 194/363] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:25 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:25.969474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480200502", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "networks": [{"uuid": "ea3a10f4-0bb5-4d93-8b49-e98853fc626e"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:26.037312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] validate_networks() for [('ea3a10f4-0bb5-4d93-8b49-e98853fc626e', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:36:26.135491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:26.146477 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d2a55310-9249-499d-b36e-b2fdbd512712 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1445 microversion: 2.1 time: 0.545963 Apr 05 11:36:26.147074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 170/364] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:25 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1445 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:26.364927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:26.368108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:26.389466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.398232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:26.399683 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.401245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:26.641867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:26.661281 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:26.680001 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:26.682801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f85a71b8-929f-4e1c-be11-70a1ebafc11b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1738 microversion: 2.20 time: 0.331240 Apr 05 11:36:26.684900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 171/365] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:26 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:26.892423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:36:26.893013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:36:26.893583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:36:26.894044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:36:26.898893 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:36:26.909483 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.909943 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:26.910795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.911238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:26.941987 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Getting quotas for project f9d646856dc44118a63f2dd56d120c2d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:26.955221 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Getting quotas for user 4cb3a9cf73004b289beb4fc420cbaad6 and project f9d646856dc44118a63f2dd56d120c2d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:26.972595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:26.973786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:26.978271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:36:26.983497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:36:26.984516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.985158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:26.986083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:26.986519 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:27.201532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:27.202217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc8df2fc-e187-4b8b-ab7b-f04a0f417200 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241213 Apr 05 11:36:27.203555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 195/366] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:36:27.214243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ad3bc2b4-fc0e-4f20-93ad-17951a43b6fb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:27.215106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ad3bc2b4-fc0e-4f20-93ad-17951a43b6fb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:27.224011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5dec980d-c92a-4c59-a3b6-482fbe24ef47 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1517 microversion: 2.1 time: 0.254865 Apr 05 11:36:27.235122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 172/367] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:26 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:27.307677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ad3bc2b4-fc0e-4f20-93ad-17951a43b6fb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:27.318321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ad3bc2b4-fc0e-4f20-93ad-17951a43b6fb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1213 microversion: 2.1 time: 0.105555 Apr 05 11:36:27.327643 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 196/368] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:27 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:27.703967 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:27.705265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:27.718723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:27.719560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:27.722228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:27.728277 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:28.152923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:28.162860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:28.164916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:28.166362 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-563d1b96-00fc-44bb-bc2f-ec655146104e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1720 microversion: 2.20 time: 0.468028 Apr 05 11:36:28.167513 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 173/369] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:27 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1720 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:28.336308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7f6533b-402a-4c97-876b-95bb005fbc66 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:28.344746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7f6533b-402a-4c97-876b-95bb005fbc66 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:28.412338 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b7f6533b-402a-4c97-876b-95bb005fbc66 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:28.420346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7f6533b-402a-4c97-876b-95bb005fbc66 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1213 microversion: 2.1 time: 0.087920 Apr 05 11:36:28.422487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 197/370] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:28 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:29.185685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:29.187101 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:29.194399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:29.194897 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:29.195919 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:29.196499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:29.438251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:29.439614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:29.450806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:29.451275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:29.452097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:29.452533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:29.555017 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:29.558906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:29.570019 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42c5e474-c361-428f-b4e7-e57e3e4916cb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1217 microversion: 2.1 time: 0.135697 Apr 05 11:36:29.570743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 198/371] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:29 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:29.575620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:29.575620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:29.575620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-24843c0a-5ea9-4d4a-9221-1d35995fc097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1720 microversion: 2.20 time: 0.392800 Apr 05 11:36:29.575924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 174/372] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:29 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1720 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:29.717464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-f3a3c5da-d07c-4022-bdb8-c8cd8f7f13d3 req-80d5e862-5189-4d81-91c7-52c22dbf1e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:29.732023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-f3a3c5da-d07c-4022-bdb8-c8cd8f7f13d3 req-80d5e862-5189-4d81-91c7-52c22dbf1e4d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:29.732819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-f3a3c5da-d07c-4022-bdb8-c8cd8f7f13d3 req-80d5e862-5189-4d81-91c7-52c22dbf1e4d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:29.746909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-f3a3c5da-d07c-4022-bdb8-c8cd8f7f13d3 req-80d5e862-5189-4d81-91c7-52c22dbf1e4d service nova] Creating event network-changed:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:36:29.755632 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-f3a3c5da-d07c-4022-bdb8-c8cd8f7f13d3 req-80d5e862-5189-4d81-91c7-52c22dbf1e4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040297 Apr 05 11:36:29.760922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 199/373] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:29.769588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: .version_select at 0x7f1382500e50>, body: {"keypair": {"name": "tempest-keypair-1522821649"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:29.785443 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:29.789629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:30.029979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:30.035961 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:30.052925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0a315733-2024-442f-93f9-c8a3b364b4fd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.287945 Apr 05 11:36:30.054554 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 175/374] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:36:29 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:30.206066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: .version_select at 0x7f1382e2da60>, body: {"keypair": {"name": "tempest-keypair-180524639"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:30.224431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:30.229207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for user 3185ec21337a4154b650b30b89519716 and project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:30.586758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:30.587371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:30.599089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:30.599862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:30.605935 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:30.613713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:30.684161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:30.699588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c45ee604-ab3b-47d0-8f09-363940611bd5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1209 microversion: 2.1 time: 0.116704 Apr 05 11:36:30.715885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 176/375] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:30 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:30.722113 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:30.722716 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:30.727380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:30.731482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for user 3185ec21337a4154b650b30b89519716 and project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:30.740156 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:30.741838 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:30.745796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:30.746522 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:30.755625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac08712c-6595-46f5-a4a8-51ca0ebbc239 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.556279 Apr 05 11:36:30.765615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 200/376] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:36:30 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:31.723615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:31.724345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:31.732621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:31.739671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:31.740116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:31.743657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:31.748177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:31.750109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:31.750284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:31.754719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-441c4429-24fa-4797-b24d-df78f0cb664b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1720 microversion: 2.20 time: 1.035788 Apr 05 11:36:31.757168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 177/377] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:30 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1720 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:31.942465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:31.952181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b595bed-e789-40b7-a04a-9178bbe3cc98 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1265 microversion: 2.1 time: 0.234732 Apr 05 11:36:31.952832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 201/378] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:31 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:31.982981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-ce89f6f5-97b8-484a-abca-cb4863cc0907 req-7a486ed5-d7ba-453a-8b8b-f29354afcbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "name": "network-vif-unplugged", "status": "completed", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:31.996812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-ce89f6f5-97b8-484a-abca-cb4863cc0907 req-7a486ed5-d7ba-453a-8b8b-f29354afcbbd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:32.002882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-ce89f6f5-97b8-484a-abca-cb4863cc0907 req-7a486ed5-d7ba-453a-8b8b-f29354afcbbd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:32.044739 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-ce89f6f5-97b8-484a-abca-cb4863cc0907 req-7a486ed5-d7ba-453a-8b8b-f29354afcbbd service nova] Creating event network-vif-unplugged:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:36:32.052225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-ce89f6f5-97b8-484a-abca-cb4863cc0907 req-7a486ed5-d7ba-453a-8b8b-f29354afcbbd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075613 Apr 05 11:36:32.058643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 178/379] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:32.778659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:32.779954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:32.809633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:32.810382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:32.812188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:32.812863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:32.971137 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:32.972820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:32.996578 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:33.017226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:33.017226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:33.017226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:33.093028 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:33.109424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:33.118038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:33.122248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ff5d2749-57fe-4350-8a4d-b6c2b8ac50f5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1723 microversion: 2.20 time: 0.347510 Apr 05 11:36:33.136878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 202/380] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:32 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:33.151374 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "304d4eba-4f5a-49d7-a059-e5d4f2fb57c8"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:33.153960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:33.174996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:33.178466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:33.180569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:33.182847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:33.210026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:33.237219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-30d41de3-8149-4665-b9fd-14c5abfc21f1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1273 microversion: 2.1 time: 0.271162 Apr 05 11:36:33.239526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 179/381] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:32 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:34.256150 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:34.258310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:34.277630 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:34.279794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:34.283900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:34.292883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:34.801075 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:34.812180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3af2e280-b9d7-4001-932f-4393f180cc9d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.557514 Apr 05 11:36:34.815400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 180/382] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:34 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:35.222574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-03bb107d-70a5-42d9-9c7c-e34e125b1b96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.078576 Apr 05 11:36:35.223820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 203/383] 10.222.0.60 () {62 vars in 1363 bytes} [Tue Apr 5 11:36:33 2022] POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments => generated 188 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:36:35.416375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:35.423645 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:35.428583 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:35.429073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:35.429939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:35.430386 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:35.441734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-898520375", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912aa55e-5878-42db-a34a-a968382fba80"}], "security_groups": [{"name": "tempest-securitygroup--1960497856"}], "key_name": "tempest-keypair-180524639", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:35.544245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] validate_networks() for [('912aa55e-5878-42db-a34a-a968382fba80', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:36:35.996395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:36:35.996822 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:36:35.997300 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:36:35.997709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:36:35.998126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:36:36.006631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-faba3834-af28-4998-86f4-6a34e01d4d98 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/action" status: 202 len: 0 microversion: 2.20 time: 0.596721 Apr 05 11:36:36.011785 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 181/384] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Apr 5 11:36:35 2022] POST /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:36:36.015392 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:36.015691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.016149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.017233 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:36.017490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.018011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.028318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.030438 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.033085 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.034130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.080814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:36.085484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Getting quotas for user 3185ec21337a4154b650b30b89519716 and project ef1490a12f854ca78e6f0f6f25418eed. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:36.100941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:36:36.107505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:36:36.253842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1c7c2a6a-d4d4-409f-82e5-faee44cdba8e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.816604 Apr 05 11:36:36.255814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 204/385] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:36:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:36:36.262654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:36.263598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:36.273721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.274940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.275958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.276883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.525119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:36.534077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-461b21c5-f55e-4ae9-ae20-dc07ba90ad48 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.524558 Apr 05 11:36:36.535620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 182/386] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:36 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:36.542809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ea311ae7-ea54-4887-8eac-c6a7f66650ec tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:36.543444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ea311ae7-ea54-4887-8eac-c6a7f66650ec tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:36.573325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:36.588165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:36.589813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:36.591105 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f76a6fd2-95c6-426b-92ab-1e465238a8d0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1749 microversion: 2.20 time: 0.334091 Apr 05 11:36:36.592104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 205/387] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:36 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1749 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:36.653746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d4f120d5-a26a-4385-978b-ee188d710fb0 req-3158b45f-9a44-4970-a7dc-78428eb95deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4678fbbd-049c-4736-a18b-83e5a239185a", "tag": "46254a19-2915-4f71-9cc7-2172c9f88106"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:36.666635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d4f120d5-a26a-4385-978b-ee188d710fb0 req-3158b45f-9a44-4970-a7dc-78428eb95deb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:36.668465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d4f120d5-a26a-4385-978b-ee188d710fb0 req-3158b45f-9a44-4970-a7dc-78428eb95deb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:36.679585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ea311ae7-ea54-4887-8eac-c6a7f66650ec tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:36.682036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d4f120d5-a26a-4385-978b-ee188d710fb0 req-3158b45f-9a44-4970-a7dc-78428eb95deb service nova] Creating event network-changed:46254a19-2915-4f71-9cc7-2172c9f88106 for instance 4678fbbd-049c-4736-a18b-83e5a239185a on hv-cinder-83444 Apr 05 11:36:36.689553 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ea311ae7-ea54-4887-8eac-c6a7f66650ec tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1244 microversion: 2.1 time: 0.149621 Apr 05 11:36:36.690163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d4f120d5-a26a-4385-978b-ee188d710fb0 req-3158b45f-9a44-4970-a7dc-78428eb95deb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039771 Apr 05 11:36:36.691280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 183/388] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:36 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1244 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:36.699983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 206/389] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:37.275051 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982489831", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83da91da-2a37-43a9-b807-df1a6d29d057"}], "security_groups": [{"name": "tempest-securitygroup--261871543"}], "key_name": "tempest-keypair-1522821649", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:37.412753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] validate_networks() for [('83da91da-2a37-43a9-b807-df1a6d29d057', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:36:37.551603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:37.555545 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:37.568231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.569567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.570725 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.571540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.828740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:37.856857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d6d5ebcc-4c69-44fd-98e5-070c8f98dcf5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.309638 Apr 05 11:36:37.868430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 184/390] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:37 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:37.886929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:37.886929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:37.899221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.900018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.901104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.901726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.949402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:36:37.950122 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:36:37.950975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:36:37.951653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:36:37.952370 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:36:37.962624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.963541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.965032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:37.965840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:37.989436 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:37.994766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:38.014881 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:36:38.017845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:36:38.176000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:38.185132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:38.186621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:38.187819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d216d8bd-e233-4f9d-82f5-c5f05b577021 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1749 microversion: 2.20 time: 0.318175 Apr 05 11:36:38.191933 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 185/391] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:37 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1749 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:38.197511 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8b8e4f5-b609-49aa-8613-4fd49e4030e2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.930639 Apr 05 11:36:38.198164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 207/392] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:36:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:36:38.205121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:38.238524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:38.238524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:38.238524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:38.238524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:38.239872 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:38.248418 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b60087c-4ed4-40ae-83bb-6c89bff115f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:38.249341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b60087c-4ed4-40ae-83bb-6c89bff115f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:38.304282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:38.316108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-61d5deec-febf-4f60-9d54-385ce277f5dc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1240 microversion: 2.1 time: 0.121018 Apr 05 11:36:38.317249 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 186/393] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:38 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:38.337734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4b60087c-4ed4-40ae-83bb-6c89bff115f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:38.342671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b60087c-4ed4-40ae-83bb-6c89bff115f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1241 microversion: 2.1 time: 0.098980 Apr 05 11:36:38.343764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 208/394] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:38 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:38.874643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:38.876949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:38.885124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:38.889988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:38.889988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:38.889988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:39.047581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.062374 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5a9ee678-0568-4e9a-b981-4dc6c494c3b9 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.191497 Apr 05 11:36:39.063252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 187/395] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:38 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:39.207657 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:39.213561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:39.220673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:39.221469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:39.222417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:39.222999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:39.347952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:39.348565 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:39.355110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:39.355110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:39.356085 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:39.356691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:39.432094 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.441057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7de2bc32-0a7e-41c9-824c-d874505dbcf3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1296 microversion: 2.1 time: 0.099291 Apr 05 11:36:39.450084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.450734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 188/396] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:39 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:39.456394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e776ca57-0f96-4717-a7de-37a06ea4b21e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:39.457092 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e776ca57-0f96-4717-a7de-37a06ea4b21e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:39.465156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.475976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.475976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ffc72e13-1986-434e-8c45-9327357a53e6 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1751 microversion: 2.20 time: 0.265503 Apr 05 11:36:39.475976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 209/397] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:39 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1751 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:39.525941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e776ca57-0f96-4717-a7de-37a06ea4b21e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:39.534719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e776ca57-0f96-4717-a7de-37a06ea4b21e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1241 microversion: 2.1 time: 0.082788 Apr 05 11:36:39.535317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 189/398] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:39 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:40.081085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:40.081715 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:40.088842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.088842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.090565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.091275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.256499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.264553 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-58887ac1-1829-4db2-bb53-403c608fc3fd tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.187738 Apr 05 11:36:40.273536 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 210/399] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:40 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:40.458388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:40.459768 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:40.466050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.466575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.467455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.467965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.494701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:40.495361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:40.534718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.535181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.538670 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.539329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.647070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.659812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-97620a8f-7d5b-45b0-972a-04c7dfd9eb16 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1296 microversion: 2.1 time: 0.205748 Apr 05 11:36:40.673362 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 190/400] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:40 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1296 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:40.679074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:40.679713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:40.686875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.687333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.689320 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:40.689761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:40.776460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.780258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.810801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-41514d8a-e54d-41e6-a42d-97fa7b8a5342 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1245 microversion: 2.1 time: 0.133526 Apr 05 11:36:40.821764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 191/401] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:40 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:40.821908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.821908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:40.821908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de873629-6250-47a9-86a5-3fd23de7d325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1751 microversion: 2.20 time: 0.325479 Apr 05 11:36:40.828221 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 211/402] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:40 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:41.281564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:41.282584 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:41.290811 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.291018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.291791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.292226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.462483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:41.473078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5f0a6a83-3719-4f44-991c-314bdda2b11e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.195855 Apr 05 11:36:41.473974 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 192/403] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:41 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:41.681925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:41.683313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:41.706294 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.707092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.709649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.709649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.831104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:41.837123 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:41.838050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:41.842401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7f40d480-6178-4f29-a36d-44d6918800fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1302 microversion: 2.1 time: 0.169889 Apr 05 11:36:41.846596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.847247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.848213 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.848810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.853297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 212/404] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:41 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1302 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:41.872343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:41.876256 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:41.905968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.906711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:41.908862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:41.909467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:42.102511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.114365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-73cf9964-77ab-4d23-ab4d-7c96c5edc4b0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1301 microversion: 2.1 time: 0.288893 Apr 05 11:36:42.124187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 193/405] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:41 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1301 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:42.129776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.139243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.140838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.142839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-13f7a5af-1d12-493e-827f-d58e1497e94a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1751 microversion: 2.20 time: 0.288224 Apr 05 11:36:42.143404 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 213/406] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:41 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:42.490381 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:42.491038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:42.501679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:42.502135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:42.502929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:42.503367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:42.784435 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.795562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7d3b89bc-7f2d-4b34-a4bf-13aa84b32a08 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.309386 Apr 05 11:36:42.806397 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 194/407] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:42 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:42.862487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:42.864894 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:42.869346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:42.870109 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:42.871177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:42.871900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:42.948662 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:42.961564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5aca8047-798d-493e-963f-e2664b58c774 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1302 microversion: 2.1 time: 0.103091 Apr 05 11:36:42.964369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 214/408] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:42 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:43.135670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:43.137179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:43.144401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.145112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.146280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.146894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.164559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:43.165325 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:43.176079 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.176674 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.179872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.179872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.316936 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:43.329484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-95bf584d-9a67-45a8-a97d-e127b77ad1f0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1299 microversion: 2.1 time: 0.200642 Apr 05 11:36:43.343142 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 195/409] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:43 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:43.454310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:43.490850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:43.518764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:43.523279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16a7610f-7a0b-462e-8911-29f4c5de1c26 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.362109 Apr 05 11:36:43.524474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 215/410] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:43 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:43.825944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:43.826551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:43.833874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.834325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.835127 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.835664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.982438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:43.983219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:43.990628 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.991151 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:43.991959 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:43.992407 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.134800 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:44.143480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3697f077-89f3-4f68-baff-d6d2092d72fc tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.166812 Apr 05 11:36:44.144065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 216/411] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:43 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:44.148466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:44.155940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-31b39ffe-b5bd-4480-afaa-5f4ba744367d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.333769 Apr 05 11:36:44.156508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 196/412] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:43 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:44.350908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:44.352080 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:44.362856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:44.363797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.365046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:44.365837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.542759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:44.544030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:44.558376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:44.567943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.570754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:44.576764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.693606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:44.702802 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f0bede9f-1420-4fc2-b01e-a7232b9ac74a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.356921 Apr 05 11:36:44.704502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 217/413] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:44 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:44.722044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-08b4d2ef-16fd-46ad-b4af-dcf258f4fbf9 req-a00f31dc-dc64-4802-b81b-890fd9ee9c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4678fbbd-049c-4736-a18b-83e5a239185a", "name": "network-vif-plugged", "status": "completed", "tag": "46254a19-2915-4f71-9cc7-2172c9f88106"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:44.730949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-08b4d2ef-16fd-46ad-b4af-dcf258f4fbf9 req-a00f31dc-dc64-4802-b81b-890fd9ee9c59 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:44.731479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-08b4d2ef-16fd-46ad-b4af-dcf258f4fbf9 req-a00f31dc-dc64-4802-b81b-890fd9ee9c59 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:44.745630 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-08b4d2ef-16fd-46ad-b4af-dcf258f4fbf9 req-a00f31dc-dc64-4802-b81b-890fd9ee9c59 service nova] Creating event network-vif-plugged:46254a19-2915-4f71-9cc7-2172c9f88106 for instance 4678fbbd-049c-4736-a18b-83e5a239185a on hv-cinder-83444 Apr 05 11:36:44.751270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-08b4d2ef-16fd-46ad-b4af-dcf258f4fbf9 req-a00f31dc-dc64-4802-b81b-890fd9ee9c59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036672 Apr 05 11:36:44.752190 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 218/414] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:45.024603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7d5130de-c442-4cde-9ef6-e974426083b6 req-3190342e-c8eb-4ae3-8efe-d532c5435251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:45.041860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7d5130de-c442-4cde-9ef6-e974426083b6 req-3190342e-c8eb-4ae3-8efe-d532c5435251 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.044009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7d5130de-c442-4cde-9ef6-e974426083b6 req-3190342e-c8eb-4ae3-8efe-d532c5435251 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.069207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7d5130de-c442-4cde-9ef6-e974426083b6 req-3190342e-c8eb-4ae3-8efe-d532c5435251 service nova] Creating event network-changed:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:36:45.075478 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7d5130de-c442-4cde-9ef6-e974426083b6 req-3190342e-c8eb-4ae3-8efe-d532c5435251 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060333 Apr 05 11:36:45.078877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 219/415] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:36:45.161573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:45.162301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:45.178375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.178838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.179659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.180105 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.279061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:45.280586 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:45.282818 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:45.284454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5d5d6128-6eb6-4f64-b020-84d49bc72e65 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.746280 Apr 05 11:36:45.285697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 197/416] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:44 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:45.290987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:45.291651 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:45.299084 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.299851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.300637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.301073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.406313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:45.425850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6a176551-f632-4a55-8b37-d78c5d57ae0e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.269298 Apr 05 11:36:45.426552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 220/417] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:45 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:45.721099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:45.721732 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:45.727675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.728152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.728879 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:45.729310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:45.871408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:45.879943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5e472039-c229-4843-b0c2-71d4eeebf47b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.593090 Apr 05 11:36:45.880540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 198/418] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:45 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:45.885996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'create', calling method: .version_select at 0x7f138255ff70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1245855514"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:45.914502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for project be5f73d3bb5948299a1d81283e0c738a. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:45.918999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for user b8f31b171e394b2fbf9d9e3e3fd6b9f9 and project be5f73d3bb5948299a1d81283e0c738a. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:46.116321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:46.124414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39989e13-70e5-4960-a54c-080deaecd894 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.407710 Apr 05 11:36:46.134609 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 221/419] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:45 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:46.182009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for project be5f73d3bb5948299a1d81283e0c738a. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:46.187189 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for user b8f31b171e394b2fbf9d9e3e3fd6b9f9 and project be5f73d3bb5948299a1d81283e0c738a. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:46.201559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-20af95e2-f547-42c2-84e6-d1793605ae41 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.319768 Apr 05 11:36:46.202426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 199/420] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:36:45 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:46.265401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2088702523", "imageRef": "cb8dec99-bdc8-474e-a395-78e5355518ff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1245855514", "networks": [{"uuid": "c77bd11c-2083-4ad7-adab-65001019d0d4"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:46.318155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:46.318155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:46.318155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.318155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.318869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.318869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.352450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] validate_networks() for [('c77bd11c-2083-4ad7-adab-65001019d0d4', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:36:46.626153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:46.635016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:46.636927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:46.638118 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-edbd54cb-d021-4a1c-b05b-b1d4c3149d27 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.337830 Apr 05 11:36:46.639059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 200/421] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:46 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:46.644032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:46.644854 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:46.651896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.652347 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.653128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.653562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.781293 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:36:46.782063 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:36:46.782848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:36:46.783344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:36:46.783855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:36:46.797679 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.798574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.799638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.800408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.822481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:46.830746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-71a9affb-f006-4a29-b1d3-482f9eb4a651 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.190503 Apr 05 11:36:46.831688 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 201/422] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:46 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:46.840377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for project be5f73d3bb5948299a1d81283e0c738a. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:36:46.842231 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Getting quotas for user b8f31b171e394b2fbf9d9e3e3fd6b9f9 and project be5f73d3bb5948299a1d81283e0c738a. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:36:46.853791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:36:46.856053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb8dec99-bdc8-474e-a395-78e5355518ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:36:46.898037 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:46.899126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:46.906717 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.907584 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:46.908759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:46.909458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.043753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d875aa0a-bbdb-484b-8c71-5f26818b9c33 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782341 Apr 05 11:36:47.045396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 222/423] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:36:47.067835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1c6ad0a1-db88-45e3-afe7-3e8d98a3f816 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:47.072767 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c6ad0a1-db88-45e3-afe7-3e8d98a3f816 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:47.090658 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.104686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aed521da-ac58-4a01-b539-4db124202876 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.210925 Apr 05 11:36:47.116680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 202/424] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:46 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:47.122268 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-b0f18249-10db-4424-b05a-df6e76adb58d req-5336485b-6bdb-495a-ba35-0d989fe9c3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd641ff-56ae-409d-bc86-8d8edb85fedb", "tag": "6bedd3d0-95f4-48c4-b38a-8ecae6e627b0"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:36:47.139343 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-b0f18249-10db-4424-b05a-df6e76adb58d req-5336485b-6bdb-495a-ba35-0d989fe9c3a2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.140104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-b0f18249-10db-4424-b05a-df6e76adb58d req-5336485b-6bdb-495a-ba35-0d989fe9c3a2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.157181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-b0f18249-10db-4424-b05a-df6e76adb58d req-5336485b-6bdb-495a-ba35-0d989fe9c3a2 service nova] Creating event network-changed:6bedd3d0-95f4-48c4-b38a-8ecae6e627b0 for instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb on hv-cinder-83444 Apr 05 11:36:47.162618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-b0f18249-10db-4424-b05a-df6e76adb58d req-5336485b-6bdb-495a-ba35-0d989fe9c3a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044363 Apr 05 11:36:47.163470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 203/425] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:36:47.168266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:47.168911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:47.176726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.177468 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.179051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.180120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.182059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1c6ad0a1-db88-45e3-afe7-3e8d98a3f816 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.200736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1c6ad0a1-db88-45e3-afe7-3e8d98a3f816 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1259 microversion: 2.1 time: 0.141056 Apr 05 11:36:47.201930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 223/426] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:47 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:47.346659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.365567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2d0c351a-3e3f-455a-b704-4fd10655115b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.200885 Apr 05 11:36:47.366322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 204/427] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:47 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:47.656419 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:47.657137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:47.664248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.664754 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.665554 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.665969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.834571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.847644 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.848868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:47.849619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:47.849820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:47.851158 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-213ff31f-2a17-4186-af88-a8ced67e124b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.198884 Apr 05 11:36:47.856625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.857406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.858360 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:47.859020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:47.863982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 224/428] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:47 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:48.009916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:48.017534 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d4db3556-7ff6-4347-bb6b-75788148f829 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.173350 Apr 05 11:36:48.018098 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 205/429] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:47 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:48.134137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:48.135666 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:48.142563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.143017 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:48.143840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.144283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:48.218836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-70cbcb12-133f-452b-bebc-d990aa250a88 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:48.220170 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-70cbcb12-133f-452b-bebc-d990aa250a88 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:48.311728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-70cbcb12-133f-452b-bebc-d990aa250a88 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:48.320301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-70cbcb12-133f-452b-bebc-d990aa250a88 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1259 microversion: 2.1 time: 0.105885 Apr 05 11:36:48.331456 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 206/430] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:48 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:48.343113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:48.351795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7eefd307-3dd2-4f53-aaec-1db991d91307 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.222091 Apr 05 11:36:48.352410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 225/431] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:48 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:48.382562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:48.383461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:48.390591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.391089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:48.392266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.392696 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:48.548623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:48.556012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2e5a17fd-a0ae-47b7-bb8e-ee11a22320e9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.177483 Apr 05 11:36:48.556584 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 207/432] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:48 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:48.869741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:48.870353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:48.876967 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.877451 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:48.878223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:48.878664 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.021589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.034191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:49.034954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:49.040127 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.041649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.041779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.042329 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.042776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73f14321-f2c5-4926-a405-6704284515d1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.176929 Apr 05 11:36:49.043303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.043482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 226/433] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:48 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:49.044083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.186240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.193910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-24cd32a9-7507-42a9-9b4f-1ee46c94446d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.163734 Apr 05 11:36:49.194474 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 208/434] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:49 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:49.338394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:49.339002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:49.345435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.346069 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.346634 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.347068 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.368361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:49.369237 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:49.375170 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.381134 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.381134 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.381134 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.412950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.430188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-94fd196a-afa1-496c-9914-ed8e428579a8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.095452 Apr 05 11:36:49.431028 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 227/435] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:49 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:49.525345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.534719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8cce4601-94d5-4107-a21f-92b02195cacb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.170097 Apr 05 11:36:49.536054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 209/436] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:49 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:49.572365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:49.572973 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:49.579522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.579972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.580729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:49.581166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:49.727359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:49.735389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cbfd88f7-59d3-437c-82a8-1f06548ee2a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.166735 Apr 05 11:36:49.736856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 228/437] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:49 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:50.060928 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:50.061620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:50.069110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.069552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.070309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.070736 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.211206 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:50.212034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:50.220121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.220794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.221673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.222514 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.228235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.250982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.253844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.256115 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-eb19365d-9619-4c4b-82bd-f0cd78ff6fab tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.198977 Apr 05 11:36:50.256700 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 210/438] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:50 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:50.415758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.430575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-95b1330c-b4d0-4fd6-bc02-89d888b39abd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.223411 Apr 05 11:36:50.431178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 229/439] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:50 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:50.447646 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:50.448276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:50.455174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.455903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.456864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.457463 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.517720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.525031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c18e577c-d128-400c-a83f-c382a3720ed5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.081331 Apr 05 11:36:50.525615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 211/440] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:50 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:50.556076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:50.556688 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:50.562846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.563686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.564827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.565432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.715830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.731618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c497d4b-0b27-4ebe-9c27-36bc9261ce30 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.179006 Apr 05 11:36:50.732663 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 230/441] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:50 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:50.753431 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:50.754059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:50.760356 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.760813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.761590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:50.762035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:50.901802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:50.910821 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8fe55f37-2f01-43cd-8808-6790c860847e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.161187 Apr 05 11:36:50.914459 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 212/442] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:50 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:51.274260 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:51.274862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:51.281007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.282055 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.283541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.283976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.439453 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.448206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:51.448965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:51.460131 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.460724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.463078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.464029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.464580 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.469837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.472085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50ab93bf-a325-426d-a3fd-045053adbe89 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.201824 Apr 05 11:36:51.473802 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 231/443] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:51 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:51.542234 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:51.542918 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:51.549469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.550045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.556072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.556703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.619016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.622454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.626792 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1f07afa4-e875-4abd-b093-3eb1a78984fd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.182516 Apr 05 11:36:51.627764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 213/444] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:51 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:51.633944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-41507f0a-25fc-43b2-8ed0-76a9f590610d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.095593 Apr 05 11:36:51.634861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 232/445] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:51 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:51.752114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:51.753005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:51.759930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.760513 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.762302 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.762742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.908865 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:51.916520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f5cf88d1-2d01-4ee3-ac9c-03718769786e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.169859 Apr 05 11:36:51.926049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 214/446] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:51 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:51.928047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:51.928739 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:51.950519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.951231 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:51.952237 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:51.952752 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.113099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.120564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a68463a4-2b80-431f-8dae-98ee85724e19 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.196436 Apr 05 11:36:52.121137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 233/447] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:51 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:52.492215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:52.492819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:52.499239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.499743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.501178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.501685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.647354 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.649635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:52.652056 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:52.663359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.664556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.664883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.665011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.665801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.666035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7d5a4ac5-ab82-4dc2-96d1-e041a90e296f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.177890 Apr 05 11:36:52.666243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.675117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 215/448] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:52 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:52.675117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:52.675117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:52.679223 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.679697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.680461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.680896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.741531 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.749062 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9aca200b-2641-44cf-abbb-9582ff2dda76 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.080941 Apr 05 11:36:52.749792 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 216/449] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:52 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:52.813465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:52.820868 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-578f4616-1b1b-4776-9f7a-6faeeec15b09 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.181126 Apr 05 11:36:52.821676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 234/450] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:52 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:52.935214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:52.936920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:52.945333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.946064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:52.958543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:52.961763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.113182 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.120924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cc980c80-b11d-46bd-aede-57ff7e8f1198 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.191333 Apr 05 11:36:53.121560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 217/451] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:52 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:53.137890 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:53.138798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:53.145806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.146242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.147033 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.147499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.299771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.307271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44233466-fb82-4516-8d82-5c5367ecf025 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.173257 Apr 05 11:36:53.310386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 235/452] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:53 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:53.685989 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:53.686851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:53.694091 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.694542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.695314 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.695777 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.767739 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:53.769020 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:53.777137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.777590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.779202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.779202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.861560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.866862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.881253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-800e9f25-1438-475f-b65a-64d842f8ec39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.118247 Apr 05 11:36:53.882759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.884305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:53.886203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 236/453] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:53 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:53.886564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aa4603e9-5a82-4995-a624-42f3050ee048 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.203489 Apr 05 11:36:53.887477 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 218/454] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:53 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:53.893066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:53.893752 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:53.900011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.900465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:53.901278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:53.901725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.066977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:54.074723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e04c290b-7a7e-4388-b403-10b072394058 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.186849 Apr 05 11:36:54.075296 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 237/455] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:53 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:54.138018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:54.138620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:54.145395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.145849 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.146624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.147059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.299903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:54.307080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bec1b673-4601-49e2-85df-064f73f1fa8d tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.172916 Apr 05 11:36:54.307679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 219/456] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:54 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:54.324550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:54.325156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:54.332435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.332963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.333759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.334204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.482626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:54.490757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a72180e-7795-4b09-9974-69aac6382ef0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.170048 Apr 05 11:36:54.494734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 238/457] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:54 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:54.902165 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:54.902948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:54.905127 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:54.905740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:54.910037 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.910488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.911262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.911725 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.912595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.913054 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.913828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:54.914274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:54.978585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:54.987105 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-be208d24-f81a-4672-b2b8-4bd55fe09b55 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.088798 Apr 05 11:36:54.987812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 220/458] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:54 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:55.072555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.082008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.083575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.084736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e63580a8-4262-4864-bf98-41c544498c6c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.183553 Apr 05 11:36:55.085627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 239/459] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:54 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:55.092135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:55.097385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:55.108331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.108789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.110448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.110857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.259027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.266924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2e710778-0ae6-4ff7-a1d1-ebeaf2321182 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.178352 Apr 05 11:36:55.267338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 221/460] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:55 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:55.325095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:55.325615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:55.337109 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.345164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.345164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.345164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.489903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.499260 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-522846ab-d593-4105-8adb-447b015ffd06 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.177938 Apr 05 11:36:55.499885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 240/461] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:55 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:55.508625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:55.518445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:55.518445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.518445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.518445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:55.518859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:55.656851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:55.665231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3535ea59-0bdf-4ed5-829d-02de7b52a802 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.160353 Apr 05 11:36:55.665820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 222/462] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:55 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:56.005467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:56.007255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:56.015230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.016683 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.017653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.018209 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.087875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.095429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a93c31a6-254b-48f9-bc0d-7c957bb69555 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.095117 Apr 05 11:36:56.096097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 241/463] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:55 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:56.104126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:56.104738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:56.111677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.112133 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.112898 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.113337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.256874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.265853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.267363 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.268678 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1b58703a-2e38-4966-a1fb-41be5a81a422 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.168399 Apr 05 11:36:56.269287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 223/464] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:56 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:56.283789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:56.284408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:56.290439 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.290896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.291816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.292262 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.435165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.443238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63bd6c9a-ed18-4898-921a-bc04f13e0af2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.163568 Apr 05 11:36:56.443835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 242/465] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:56 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:56.517155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:56.517792 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:56.523865 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.524325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.525113 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.525547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.661664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.669114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-218dfd0e-0706-4e21-87e1-8516b703e334 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1313 microversion: 2.1 time: 0.156502 Apr 05 11:36:56.669676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 224/466] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:56 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:56.683563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:56.684180 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:56.690766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.691218 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.692018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:56.692457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:56.826542 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:56.834034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f253449-4cb0-4a94-afc5-a4a7adac8e3e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.154384 Apr 05 11:36:56.834606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 243/467] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:56 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:57.112885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:57.113505 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:57.119980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.120433 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.121201 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.121738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.181952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.189977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-60e9b041-fbf9-45ec-834d-b7d2cc238248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.081616 Apr 05 11:36:57.190542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 225/468] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:57 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:57.287185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:57.287795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:57.294059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.294499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.295259 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.295730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.436816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.446084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.447631 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.448798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-594c1013-37fd-47fa-847f-e3a596a8f717 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.165643 Apr 05 11:36:57.449365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 244/469] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:57 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:57.460218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:57.460855 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:57.466812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.467258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.468044 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.468479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.606315 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.614924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-24e532b4-02dd-4ecd-b2b6-dbbe8bc25720 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.158665 Apr 05 11:36:57.615508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 226/470] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:57 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:57.686819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:57.688057 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:57.694009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.694463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.695230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.695706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.844061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:57.850585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:57.851200 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:57.851708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2b3a298f-7564-416f-9d2b-cfe3d6933442 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1497 microversion: 2.1 time: 0.168663 Apr 05 11:36:57.852282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 245/471] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:57 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:57.857350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.857803 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.858569 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:57.859006 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:57.997058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.004517 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-60fe34d3-fd07-4f51-8c88-de8b6b4a63f4 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.157792 Apr 05 11:36:58.005090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 227/472] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:57 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:36:58.207508 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:58.208020 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:58.213829 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.214275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.215030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.215486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.276626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.284671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e078c61-4d3d-4691-88d0-e42001ce6639 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1263 microversion: 2.1 time: 0.081876 Apr 05 11:36:58.285246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 246/473] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:58 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:58.467622 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:58.469018 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:58.476574 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.477056 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.477991 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.478425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.634449 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:58.635083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:58.643188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.643700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.644516 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:58.644962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:58.671105 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.680442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.681936 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.683216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-78afa509-0497-4f6b-860b-b9d7e78af8d2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.219656 Apr 05 11:36:58.683802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 228/474] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:58 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:36:58.837446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:58.842991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-178e15d8-ccf8-41c1-ab23-6146b3e7f5ab tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.212483 Apr 05 11:36:58.843720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 247/475] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:58 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:59.021195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.021795 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.028758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.030387 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.032095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.032559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.277823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.277823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.278307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.278803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.279816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.280640 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.314922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:36:59.386456 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.394827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-69703a31-d0a0-4971-9fe4-981dbdf4581f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.377099 Apr 05 11:36:59.395575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 229/476] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:59 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:59.400240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.400971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.408336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.408898 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.417390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.417390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.526245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.533528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e9d1d8dc-e269-45c8-8e87-d4b391f9014f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1255 microversion: 2.1 time: 0.136770 Apr 05 11:36:59.540013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 230/477] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:59 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1255 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:36:59.701523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae31520f-147a-4b15-8442-e40865649512 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 204 len: 0 microversion: 2.1 time: 0.434014 Apr 05 11:36:59.702213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 248/478] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:36:59 2022] DELETE /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:36:59.703029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.703848 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.710832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.710832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.711022 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.711408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.711659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.712219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.718085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.719038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.720122 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.720567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.888522 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.898258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.900124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.901366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a2be00ab-20ec-40be-99cb-c1c540fa5119 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.203217 Apr 05 11:36:59.902034 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 231/479] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:36:59 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:36:59.903606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:36:59.907527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:36:59.908482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:36:59.918370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.918370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.918370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:36:59.918370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:36:59.918741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-89bc4dc7-cef5-44fc-8a6c-5df105e13f45 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1503 microversion: 2.1 time: 0.211304 Apr 05 11:36:59.919720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 249/480] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:59 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:00.060278 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:00.072011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-02fdc4c0-8aca-4289-af27-0f71a6189224 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.168677 Apr 05 11:37:00.072624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 232/481] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:36:59 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:00.412149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:00.412776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:00.418697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.422272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.422272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.422272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.554528 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:00.555652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:00.557734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:00.563318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.563869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.564687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.565074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.566661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-99528fb4-7bf2-42ee-8b34-740c0c44884c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.158444 Apr 05 11:37:00.567536 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 250/482] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:00 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:00.626104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:00.633430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-57ac5e75-0ceb-4ac5-adc1-9b21e2261f4e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1311 microversion: 2.1 time: 0.083754 Apr 05 11:37:00.634000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 233/483] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:00 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:00.919989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:00.920595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:00.927510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.927980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.928729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.929165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.938052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:00.938668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:00.944623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.945080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:00.945858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:00.946300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.064423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.072712 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.074226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.075388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ebff4938-e50d-4cde-8d84-094d9c265bae tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.159265 Apr 05 11:37:01.075991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 251/484] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:00 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:01.080668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.089011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c6d88aa9-a9e4-4779-9980-b66637509da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1503 microversion: 2.1 time: 0.156396 Apr 05 11:37:01.089575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 234/485] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:00 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:01.090063 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:01.090746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:01.097383 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.097842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.098629 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.099072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.240996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.248812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-182aad94-0bdf-4f95-9eef-daa7c277e0e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.162509 Apr 05 11:37:01.249424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 252/486] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:01 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:01.584210 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:01.585020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:01.590710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.591179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.591987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.592425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.650056 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:01.650672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:01.657140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.657590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.658368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:01.658804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:01.720720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.730325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:01.730528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-058ba1d4-8293-4e58-ab0c-8c5b1cdf1252 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1311 microversion: 2.1 time: 0.084003 Apr 05 11:37:01.731268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 253/487] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:01 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:01.738952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fcbf811f-82b8-4143-a4a9-1d5f4d12a006 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.158852 Apr 05 11:37:01.740061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 235/488] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:01 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:02.088592 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d2cd94a4-4cf4-488b-a0d2-32bd6ae124ad req-0870f20a-241c-4758-9c3f-329c86fd60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "name": "network-vif-plugged", "status": "completed", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:02.093810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:02.094620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:02.100823 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.101416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.102289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.102754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.105954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d2cd94a4-4cf4-488b-a0d2-32bd6ae124ad req-0870f20a-241c-4758-9c3f-329c86fd60b1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.106401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d2cd94a4-4cf4-488b-a0d2-32bd6ae124ad req-0870f20a-241c-4758-9c3f-329c86fd60b1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.118242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d2cd94a4-4cf4-488b-a0d2-32bd6ae124ad req-0870f20a-241c-4758-9c3f-329c86fd60b1 service nova] Creating event network-vif-plugged:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:37:02.123187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d2cd94a4-4cf4-488b-a0d2-32bd6ae124ad req-0870f20a-241c-4758-9c3f-329c86fd60b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039362 Apr 05 11:37:02.124023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 254/489] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:02.129890 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:02.131646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:02.136842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.137311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.138140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.138600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.257112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.267660 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.269177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.270348 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9e68f7a2-9611-4f6e-942a-960b79263231 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.180500 Apr 05 11:37:02.270947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 236/490] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:02 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:02.275333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:02.275969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:02.282157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.282617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.283582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.283859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.286026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.293424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b081b72b-d0df-40f8-8a94-8d614d46d4be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1503 microversion: 2.1 time: 0.168352 Apr 05 11:37:02.294215 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 255/491] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:02 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:02.417406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.426084 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aa57cd51-eca9-4040-ae88-04af474ceaaf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.153999 Apr 05 11:37:02.426645 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 237/492] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:02 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:02.754079 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:02.754699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:02.760703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.761155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.761937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.762195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:02.762668 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.763026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:02.782937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.783373 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.784264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:02.784709 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:02.830533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.838287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c078de5-6f2f-48d1-8685-6a21492b2602 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1311 microversion: 2.1 time: 0.088341 Apr 05 11:37:02.838887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 256/493] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:02 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:02.946875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:02.955000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6645fcf7-9c7c-47ad-85be-1d4578454fd5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.196937 Apr 05 11:37:02.955610 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 238/494] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:02 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:03.288808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:03.289481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:03.299283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.299790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.300570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.301008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.315754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:03.316540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:03.330049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.336295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.336295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.336295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.497093 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:03.507299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:03.508935 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:03.510531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9944d8a8-86cf-4994-a912-0d244e85b9e4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.226012 Apr 05 11:37:03.522049 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 257/495] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:03 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:03.528115 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:03.528791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:03.537625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.538264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.539187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.539758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.691548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:03.699276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8f2996d-78d5-4f39-aa34-ad6af6a93a3f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.186899 Apr 05 11:37:03.699896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 258/496] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:03 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:03.858107 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:03.859960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:03.869419 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.869941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.871193 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.871642 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.955380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:03.966055 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7fd8b457-cb24-48ff-9009-c0fee185e292 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1319 microversion: 2.1 time: 0.111579 Apr 05 11:37:03.977701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 259/497] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:03 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:03.982926 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:03.983595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:03.990590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.991037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:03.991840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:03.992272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.015605 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:04.023595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-964e8aa4-0cf7-49e1-86c0-edf3b5302500 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1503 microversion: 2.1 time: 0.714668 Apr 05 11:37:04.024375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 239/498] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:03 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1503 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:04.143291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:04.159807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-89b4d0dd-e19d-4d78-b718-875e38ace417 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.180731 Apr 05 11:37:04.161077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 260/499] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:03 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:04.348956 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-65be7e43-7536-4550-a634-5cd7a3504e21 req-e45063b2-7d38-4003-8afe-59a6efa25243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4678fbbd-049c-4736-a18b-83e5a239185a", "name": "network-vif-deleted", "tag": "46254a19-2915-4f71-9cc7-2172c9f88106"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:04.357166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-65be7e43-7536-4550-a634-5cd7a3504e21 req-e45063b2-7d38-4003-8afe-59a6efa25243 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.357637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-65be7e43-7536-4550-a634-5cd7a3504e21 req-e45063b2-7d38-4003-8afe-59a6efa25243 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.369226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-65be7e43-7536-4550-a634-5cd7a3504e21 req-e45063b2-7d38-4003-8afe-59a6efa25243 service nova] Creating event network-vif-deleted:46254a19-2915-4f71-9cc7-2172c9f88106 for instance 4678fbbd-049c-4736-a18b-83e5a239185a on hv-cinder-83444 Apr 05 11:37:04.374160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-65be7e43-7536-4550-a634-5cd7a3504e21 req-e45063b2-7d38-4003-8afe-59a6efa25243 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028899 Apr 05 11:37:04.374947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 240/500] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:04.529688 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:04.530303 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:04.537494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.537931 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.538708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.539138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.673719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:04.682096 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:04.683615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:04.684770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1573ae88-29ec-4c0b-acde-9bc595397f0e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.159130 Apr 05 11:37:04.685337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 261/501] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:04 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:04.716746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:04.717453 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:04.723541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.724003 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.725027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.725198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.984562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:04.985805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:04.991577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.992021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:04.992785 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:04.993227 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.037371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.044726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7ead7819-7e04-40ec-af9d-59dd75166c02 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.332138 Apr 05 11:37:05.045295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 241/502] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:04 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:05.058366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.059029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:05.059661 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:05.066293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.066742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.067106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2cd826a9-1203-426e-a409-32d831bbf095 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1329 microversion: 2.1 time: 0.086837 Apr 05 11:37:05.067540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.067728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 262/503] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:04 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1329 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:05.067977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.137036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.145214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-056110a2-e945-42e2-b1df-7868d927d9eb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1298 microversion: 2.1 time: 0.089714 Apr 05 11:37:05.145788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 242/504] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:05 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:05.180208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:05.180958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:05.186978 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.188424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.188852 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.189290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.335672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.344231 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b3a20c73-1d8e-448c-8f5a-1f0fc1166dd0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.167069 Apr 05 11:37:05.344919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 263/505] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:05 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:05.704655 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:05.705451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:05.711881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.712334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.713115 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:05.713552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:05.861132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.875643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.878844 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:05.880260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b2130ee2-8266-42c7-ba94-fef3f7f686f7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.179811 Apr 05 11:37:05.883526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 243/506] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:05 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:06.120039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:06.120039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:06.120039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.120039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.120906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.120906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.121168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:06.121168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:06.121168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.121168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.121769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.121769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.216708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:06.224973 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88bb7130-7333-4f0a-af5e-b93f4d443bb7 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1370 microversion: 2.1 time: 0.166665 Apr 05 11:37:06.225555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 264/507] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:06 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:06.235264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:06.235264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:06.237554 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.238013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.238856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.239457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.254703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:06.262153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-50e373c0-8d7e-4583-99f1-8e8e57d9d1e2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.181533 Apr 05 11:37:06.262723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 244/508] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:06 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:06.301497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:06.309009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-74668098-c7f2-4307-9b25-121b67572675 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1298 microversion: 2.1 time: 0.082494 Apr 05 11:37:06.309585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 265/509] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:06 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:06.361801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:06.362414 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:06.368598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.369214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.370001 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.370495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.448992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7f665549-aabc-4d11-9b35-3520decbfc61 req-bbfcc416-85c8-442b-8fe3-291bb9d57d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd641ff-56ae-409d-bc86-8d8edb85fedb", "name": "network-vif-plugged", "status": "completed", "tag": "6bedd3d0-95f4-48c4-b38a-8ecae6e627b0"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:06.461263 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7f665549-aabc-4d11-9b35-3520decbfc61 req-bbfcc416-85c8-442b-8fe3-291bb9d57d5f service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.461779 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7f665549-aabc-4d11-9b35-3520decbfc61 req-bbfcc416-85c8-442b-8fe3-291bb9d57d5f service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.475578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7f665549-aabc-4d11-9b35-3520decbfc61 req-bbfcc416-85c8-442b-8fe3-291bb9d57d5f service nova] Creating event network-vif-plugged:6bedd3d0-95f4-48c4-b38a-8ecae6e627b0 for instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb on hv-cinder-83444 Apr 05 11:37:06.480340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7f665549-aabc-4d11-9b35-3520decbfc61 req-bbfcc416-85c8-442b-8fe3-291bb9d57d5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Apr 05 11:37:06.481274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 266/510] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:37:06.511031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:06.519192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-68bd6ab3-eca6-46cf-88e6-8afa516883e3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.162035 Apr 05 11:37:06.519806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 245/511] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:06 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:06.901149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:06.901988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:06.908954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.909519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:06.911241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:06.911844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.104708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.113972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.115549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.116723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-162cc30f-f81e-486a-99c7-8af6f43e6042 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.220208 Apr 05 11:37:07.119456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 267/512] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:06 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:07.254725 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:07.257600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:07.276316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.277158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.278294 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.282120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.286497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:07.292538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:07.310564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.311064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.312845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.314704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.544697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.553984 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bf2e24aa-87d1-4b28-b282-a606328d44d1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.276613 Apr 05 11:37:07.554667 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 268/513] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:07 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:07.559646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:07.560327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:07.567749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.568446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.569396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.569992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.605287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.606193 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.606846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:07.615852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.646911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dcb9d80e-be28-4de1-a6ab-231655b85bd5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1565 microversion: 2.1 time: 0.407437 Apr 05 11:37:07.648668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 246/514] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:07 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1565 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:07.655275 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:07.656839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:07.664533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.665283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.666284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.666963 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.688333 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:07.702724 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8669441e-ac74-4a02-aefe-67cacd6df155 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.146671 Apr 05 11:37:07.704164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 269/515] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:07 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:07.723841 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:07.729716 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:07.742708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.746065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.747525 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.747979 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.919432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7cab373d-eef8-4088-a99b-313f67a4118a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213123 Apr 05 11:37:07.926426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 270/516] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:37:07 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-interface => generated 285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:07.926885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-952ffc70-c507-44b3-9cd6-6a455b46f8d5 req-0f48b152-7ab0-471b-8357-6c5db363c186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:07.949950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-952ffc70-c507-44b3-9cd6-6a455b46f8d5 req-0f48b152-7ab0-471b-8357-6c5db363c186 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:07.950413 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-952ffc70-c507-44b3-9cd6-6a455b46f8d5 req-0f48b152-7ab0-471b-8357-6c5db363c186 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:07.967697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-952ffc70-c507-44b3-9cd6-6a455b46f8d5 req-0f48b152-7ab0-471b-8357-6c5db363c186 service nova] Creating event network-changed:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:37:07.983675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-952ffc70-c507-44b3-9cd6-6a455b46f8d5 req-0f48b152-7ab0-471b-8357-6c5db363c186 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059050 Apr 05 11:37:07.983675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 271/517] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:08.136798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:08.137528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:08.145769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.146110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.147137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.147780 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.175166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.187713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-06d54e43-a573-49eb-a634-247bcf0e9982 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.536994 Apr 05 11:37:08.189721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 247/518] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:07 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:08.346527 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.358500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.360669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.363484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c40a0fd-c710-42b3-90fa-4d819a861368 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.230157 Apr 05 11:37:08.363484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 272/519] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:08 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:08.573626 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:08.574265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:08.581514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.581971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.582869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.583315 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.722057 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:08.722791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:08.735394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.741296 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.742901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.743486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.799310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:08.800076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:08.800666 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:08.851061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.853178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:08.859238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a49fa89-0151-4094-83bb-a6b126338042 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.142216 Apr 05 11:37:08.859863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 273/520] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:08 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:08.861125 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-553d4dd5-e241-4480-b65e-9afc36bf65ac tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.291685 Apr 05 11:37:08.861703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 248/521] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:08 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:09.209921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:09.210895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:09.217665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.218217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.219258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.219882 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.385498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:09.394737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:09.406981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.407802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.409112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.410444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.531725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:09.544649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-638c5823-2b25-473b-817c-367dc4188867 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.338566 Apr 05 11:37:09.554537 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 274/522] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:09 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:09.601260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:09.612952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:09.614771 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:09.616199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-07e87660-3277-4e0f-b75b-17fc97ef54a8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.239141 Apr 05 11:37:09.619240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 249/523] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:09 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:09.877247 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:09.877866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:09.878905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:09.879892 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:09.894558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.895633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.896698 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.898551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.899367 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.899744 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.900535 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.901132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.977517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:09.977970 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:09.978429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:10.042170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.050704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3344d5a8-8274-4e6a-b7af-7096c98c0da1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.177667 Apr 05 11:37:10.051322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 275/524] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:09 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:10.057173 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-99685dff-c1ef-4b5a-8d22-911fc9673dd6 req-0dff8db2-c08d-4a29-befe-2542e37c7d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:10.067771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-99685dff-c1ef-4b5a-8d22-911fc9673dd6 req-0dff8db2-c08d-4a29-befe-2542e37c7d3a service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.068396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-99685dff-c1ef-4b5a-8d22-911fc9673dd6 req-0dff8db2-c08d-4a29-befe-2542e37c7d3a service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.082553 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-99685dff-c1ef-4b5a-8d22-911fc9673dd6 req-0dff8db2-c08d-4a29-befe-2542e37c7d3a service nova] Creating event network-changed:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:37:10.088427 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-99685dff-c1ef-4b5a-8d22-911fc9673dd6 req-0dff8db2-c08d-4a29-befe-2542e37c7d3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 Apr 05 11:37:10.089611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 276/525] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:10.098306 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-da8854cb-f5b3-4ca2-8431-dc376e1a31d4 req-dae289d7-87ff-4fcd-878d-dfbc581ef581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "name": "network-vif-plugged", "status": "completed", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:10.113647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-da8854cb-f5b3-4ca2-8431-dc376e1a31d4 req-dae289d7-87ff-4fcd-878d-dfbc581ef581 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.116488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-da8854cb-f5b3-4ca2-8431-dc376e1a31d4 req-dae289d7-87ff-4fcd-878d-dfbc581ef581 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.130693 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-da8854cb-f5b3-4ca2-8431-dc376e1a31d4 req-dae289d7-87ff-4fcd-878d-dfbc581ef581 service nova] Creating event network-vif-plugged:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:37:10.136813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-da8854cb-f5b3-4ca2-8431-dc376e1a31d4 req-dae289d7-87ff-4fcd-878d-dfbc581ef581 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045675 Apr 05 11:37:10.143664 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 277/526] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:10.172980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.193009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-810c3419-fdeb-4880-af2a-bb876929f92e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.319603 Apr 05 11:37:10.202147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 250/527] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:09 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:10.574153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:10.576311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:10.582279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.582736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.583555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.584002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.634541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:10.640029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:10.642224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.642682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.643517 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.644144 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.789876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.799172 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b0751c5-7e1a-4142-b275-8fa9507358bd tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.229728 Apr 05 11:37:10.804505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 278/528] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:10 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:10.804505 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:10.805375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:10.817515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.818435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.829437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:10.831974 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:10.842396 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.852710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.854607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:10.856225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-75c65cd3-8419-4ea8-8789-c2897892f04d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.225477 Apr 05 11:37:10.857046 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 251/529] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:10 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:11.005213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lazy-loading 'services' on Instance uuid 271ec1c3-3848-4d8c-99be-ecc15be7f06f {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:11.068220 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:11.069010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:11.077096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.078198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.078996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.079395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.112111 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.112925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.113606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:11.163885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:11.172276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-016e9fa8-7fee-4951-9af6-673a3f130c2b tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.107720 Apr 05 11:37:11.173081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 252/530] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:11 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:11.212424 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:11.213160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:11.220073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.220529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.221303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.221757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.356615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c556731-e254-4f1f-b106-e385bd22333f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments/79925c00-c404-468e-8751-8670bdd46ae1" status: 202 len: 0 microversion: 2.1 time: 0.555469 Apr 05 11:37:11.357331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 279/531] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:37:10 2022] DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments/79925c00-c404-468e-8751-8670bdd46ae1 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:37:11.378751 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:11.388095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5e57f16f-d088-4951-825c-8cce6620c248 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.179450 Apr 05 11:37:11.388950 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 253/532] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:11 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:11.817558 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:11.819289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:11.833941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.833941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.834745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.835184 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.881290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:11.881907 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:11.891621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.892080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:11.892882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:11.893319 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.030889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.039037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98f08d8c-6e7b-43f1-9b94-c670587e34fe tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.227121 Apr 05 11:37:12.039650 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 280/533] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:11 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:12.075006 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.084155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.085668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.086833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8aee67da-0584-4730-bb0c-4fab04f3bd8e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.209551 Apr 05 11:37:12.087394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 254/534] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:11 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:12.190511 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:12.191257 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:12.197565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:12.198018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.198808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:12.199244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.230303 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:12.230767 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.231226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:12.276534 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.285746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de665da5-9dc4-4e67-9970-a5133a81b60e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.099363 Apr 05 11:37:12.295349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 281/535] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:12 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:12.408136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:12.408934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:12.416404 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:12.417361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.419037 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:12.419785 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:12.578811 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:12.586577 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e33166f6-f79c-4f80-a485-96c6e6ece70e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.183030 Apr 05 11:37:12.587536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 255/536] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:12 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:13.056615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:13.057290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:13.064282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.064734 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.065509 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.065944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.107975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:13.107975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:13.114641 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.114902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.115656 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.116271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.237655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.241896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d60047b0-89fb-405b-83c1-cbc77a3f5eff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.189053 Apr 05 11:37:13.242680 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 282/537] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:13 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:13.288073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.297290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.299006 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.300372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-614f6247-76dc-4f18-800f-15ebc51974ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.198200 Apr 05 11:37:13.301134 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 256/538] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:13 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:13.317083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:13.317621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:13.323766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.324212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.324983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.325408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.360259 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.360701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.361168 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:13.402222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.410899 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ff5013c-ddc8-4c64-91bc-00c828beafe0 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.097787 Apr 05 11:37:13.411888 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 283/539] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:13 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:13.603087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:13.603642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:13.609747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.610198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.610962 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:13.611397 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:13.749760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:13.758273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-546268ae-4631-447c-aebe-fdbabdd8121d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.159133 Apr 05 11:37:13.767815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 257/540] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:13 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:14.258983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:14.259652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:14.266111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.266561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.267339 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.267916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.319061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:14.319789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:14.327057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.327730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.328724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.329167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.430578 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.440096 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ab17935-ca69-4ec1-a847-d4758a71a76c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.184826 Apr 05 11:37:14.455681 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 284/541] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:14 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:14.456098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:14.456702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:14.463016 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.463490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.464424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.464864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.501184 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.501633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.502087 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:14.518225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.529089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.530762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.531964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8e5949d8-82dc-4176-90e8-4aaa19ecf6a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.216993 Apr 05 11:37:14.545862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.546050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 258/542] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:14 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:14.552305 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-572d550b-66e8-4d59-8f33-28c211f4a1d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.100561 Apr 05 11:37:14.552919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 285/543] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:14 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:14.777245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:14.777699 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:14.783969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.784442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.785326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:14.785760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:14.929654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:14.938235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1de940f8-ae8d-4a7d-a6b4-ac952466a776 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.166177 Apr 05 11:37:14.939005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 259/544] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:14 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:15.458548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:15.459156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:15.465388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.465839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.466618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.467055 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.550852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:15.551492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:15.557770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.558355 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.559003 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.559511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.627252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:15.635750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39bc5bc2-19db-4dce-9283-1b949459063e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.180821 Apr 05 11:37:15.645391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 286/545] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:15 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:15.645391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:15.645391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:15.656380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.657326 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.658565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.659350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.697883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.698335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.698784 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:15.743594 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:15.747481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:15.754047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f070eb5-0a1f-4de6-b2f7-a3c0df47325c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.116932 Apr 05 11:37:15.755399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 287/546] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:15 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:15.757794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:15.759467 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:15.760739 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d7ba1ff4-538a-42ee-a6ac-c4cd51a4db8f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.214510 Apr 05 11:37:15.761421 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 260/547] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:15 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:15.954292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:15.954904 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:15.962528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.963073 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:15.963837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:15.964281 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.117832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.126239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-429ac000-c8bb-4cb1-aa87-6412bc182be2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.175854 Apr 05 11:37:16.135481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 288/548] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:15 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:16.653874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:16.654418 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:16.660845 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.661295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.662091 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.662526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.771955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:16.772565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:16.778643 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.779093 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.779939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.780442 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.796236 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.804154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-df20aa94-114c-407b-b77c-bd89f8c0ee0f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.154037 Apr 05 11:37:16.804728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 261/549] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:16 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:16.809114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:16.809862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:16.815750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.816199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.816382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.816649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid 4678fbbd-049c-4736-a18b-83e5a239185a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:16.816832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.817596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:16.818035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:16.855948 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.863342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9221e35-3da5-4c99-913c-052570082702 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 200 len: 1303 microversion: 2.1 time: 0.095271 Apr 05 11:37:16.863945 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 289/550] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:16 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:16.956082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.964295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.965773 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:16.967520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e3a6addf-f3a3-4f49-9bf3-042d48526f5d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.161858 Apr 05 11:37:16.968714 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 262/551] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:16 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:17.142465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:17.143181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:17.149161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.149655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.150432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.150874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.290823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:17.299943 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43e3e0f4-ebd0-42e1-a538-75bf9b1e7529 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.161325 Apr 05 11:37:17.300535 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 290/552] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:17 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:17.822016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:17.823408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:17.830240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.830779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.831673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.832191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.880862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:17.881625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: 4678fbbd-049c-4736-a18b-83e5a239185a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:17.888757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.889215 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.890047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:17.890498 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:17.904596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] HTTP exception thrown: Instance 4678fbbd-049c-4736-a18b-83e5a239185a could not be found. Apr 05 11:37:17.905290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Returning 404 to user: Instance 4678fbbd-049c-4736-a18b-83e5a239185a could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:37:17.906332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d30069f0-5e3b-40f8-85ae-3c1c4554a14c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a" status: 404 len: 111 microversion: 2.1 time: 0.029163 Apr 05 11:37:17.906907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 291/553] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:17 2022] GET /compute/v2.1/servers/4678fbbd-049c-4736-a18b-83e5a239185a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:37:17.963733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1926548953", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "networks": [{"uuid": "ea3a10f4-0bb5-4d93-8b49-e98853fc626e"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:18.017810 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] validate_networks() for [('ea3a10f4-0bb5-4d93-8b49-e98853fc626e', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:37:18.258488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.266822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cc7e507e-f37a-4679-8888-4bf77536c0b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.448818 Apr 05 11:37:18.267393 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 263/554] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:17 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:18.272307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:18.273136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:18.278753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.279589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.280048 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.281029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.382527 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:37:18.392538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:37:18.392538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:37:18.392538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:37:18.392538 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:37:18.394788 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.395236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.396085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.396522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.414207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Getting quotas for project f9d646856dc44118a63f2dd56d120c2d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:37:18.418546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Getting quotas for user 4cb3a9cf73004b289beb4fc420cbaad6 and project f9d646856dc44118a63f2dd56d120c2d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:37:18.418922 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.428682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.430180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.431311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:37:18.431495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-387b357c-a580-4e68-b14c-b5805529542a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.162700 Apr 05 11:37:18.431902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 264/555] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:18 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:18.433951 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:37:18.436174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:18.438136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:18.444529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.444970 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.445727 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:18.446161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:18.558450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a96e1224-e1ec-42f2-a2da-7e1822f6ecbc tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598381 Apr 05 11:37:18.559408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 292/556] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:37:18.570264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d190723f-ff3b-4416-88be-a2001da72669 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:18.571023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d190723f-ff3b-4416-88be-a2001da72669 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:18.627571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d190723f-ff3b-4416-88be-a2001da72669 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.634152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d190723f-ff3b-4416-88be-a2001da72669 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1214 microversion: 2.1 time: 0.067853 Apr 05 11:37:18.634932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 293/557] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:18 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:18.747112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:18.755075 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-365717fc-ea36-404b-a50c-c0d7659cff20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.322242 Apr 05 11:37:18.758489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 265/558] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:18 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:19.283288 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:19.283974 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:19.291655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.292106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.292895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.293312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.431743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.439492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1384db1a-4118-4de9-b9e9-606fae4b2a5e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1366 microversion: 2.1 time: 0.160594 Apr 05 11:37:19.445014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 294/559] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:19 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:19.450178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:19.450808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:19.457825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.458266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.459090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.459533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.650163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:19.651028 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:19.657618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.658150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.658987 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.659525 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.666333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.674870 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.676416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.677595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-03c703e1-4e91-40fd-a245-bff0f3bf446f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.231190 Apr 05 11:37:19.678271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 266/560] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:19 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:19.723665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.731014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c764757a-982a-4f09-b504-b3fcbd91cebb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1218 microversion: 2.1 time: 0.084836 Apr 05 11:37:19.735095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 295/561] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:19 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:19.772813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:19.775225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:19.779498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.779890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.780724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.781282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.914261 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44e3f7ce-18e4-491c-b50f-03b1f4f59464 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:19.920187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44e3f7ce-18e4-491c-b50f-03b1f4f59464 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:19.920643 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44e3f7ce-18e4-491c-b50f-03b1f4f59464 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:19.922039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:19.929471 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0877f843-c0c1-4cca-a3a7-3f62af8f26b5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.160593 Apr 05 11:37:19.930038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 267/562] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:19 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:19.943408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44e3f7ce-18e4-491c-b50f-03b1f4f59464 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Going to try to stop instance {{(pid=124242) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 11:37:20.178244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44e3f7ce-18e4-491c-b50f-03b1f4f59464 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action" status: 202 len: 0 microversion: 2.1 time: 0.267572 Apr 05 11:37:20.178934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 296/563] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:37:19 2022] POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:37:20.187442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.188109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.194067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.194519 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.195343 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.195814 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.328644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:20.336439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-045607ac-f5e2-4df7-b58c-d631f691ac38 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1722 microversion: 2.1 time: 0.153558 Apr 05 11:37:20.337008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 268/564] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:20.457203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.457831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.464043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.464502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.465273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.465711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.596776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:20.604157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-79e4388f-ed1c-49b4-9c73-2afece3c35b8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1555 microversion: 2.1 time: 0.151697 Apr 05 11:37:20.604730 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 297/565] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:20.620888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.621409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.627686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.628143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.628920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.629359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.698707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.699450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.707775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.708168 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.709139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.709626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.828428 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-950d8167-3968-4954-a012-7f9395d315a7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211347 Apr 05 11:37:20.829021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 269/566] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:20.837426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.839248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.848053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.848514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.849475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.850192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.887663 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:20.899787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:20.901410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:20.902815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05a08654-f53d-4eeb-9468-79f51a5eb75a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.208847 Apr 05 11:37:20.904137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 298/567] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:20.948435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:20.949048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:20.956295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.956891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:20.957964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:20.958336 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:21.003543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:21.011196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e3410623-c3b6-43bb-a755-87ecd325df1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1210 microversion: 2.1 time: 0.180896 Apr 05 11:37:21.012356 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 270/568] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:21.110204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:21.117014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d9fd7fe-4af9-4327-a096-a944f99389fa tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.173109 Apr 05 11:37:21.118001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 299/569] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:20 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:21.354096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:21.354701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:21.361406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:21.361853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:21.362625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:21.363059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:21.731890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:21.739908 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c04c17fc-6b3f-4b97-8c38-e07e10425d13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.389649 Apr 05 11:37:21.740408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 271/570] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:21 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:21.923008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:21.923743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:21.932786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:21.932786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:21.932786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:21.932786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.028536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:22.029486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:22.037427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.038135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.039107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.039759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.076283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.086025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.087957 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.089276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-652ad6ae-7762-453d-8769-fd246a296f6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.171877 Apr 05 11:37:22.113491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 300/571] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:21 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:22.118072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.127213 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a9d64d9b-f535-40aa-acb2-317c78499734 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1266 microversion: 2.1 time: 0.102411 Apr 05 11:37:22.143181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 272/572] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:22 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:22.143317 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:22.143317 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:22.148721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.149301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.150262 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.150876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.306741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.316151 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16b174d9-183d-4d4f-9a93-018a677e1060 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.180761 Apr 05 11:37:22.317169 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 301/573] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:22 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:22.565718 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-f892886d-2371-4c93-b852-10662b786e00 req-4e8dd4ab-b02f-492f-98e5-bd1e93fbf2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd641ff-56ae-409d-bc86-8d8edb85fedb", "tag": "6bedd3d0-95f4-48c4-b38a-8ecae6e627b0"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:22.573758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f892886d-2371-4c93-b852-10662b786e00 req-4e8dd4ab-b02f-492f-98e5-bd1e93fbf2ef service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.574282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f892886d-2371-4c93-b852-10662b786e00 req-4e8dd4ab-b02f-492f-98e5-bd1e93fbf2ef service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.585651 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-f892886d-2371-4c93-b852-10662b786e00 req-4e8dd4ab-b02f-492f-98e5-bd1e93fbf2ef service nova] Creating event network-changed:6bedd3d0-95f4-48c4-b38a-8ecae6e627b0 for instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb on hv-cinder-83444 Apr 05 11:37:22.590743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-f892886d-2371-4c93-b852-10662b786e00 req-4e8dd4ab-b02f-492f-98e5-bd1e93fbf2ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029664 Apr 05 11:37:22.591331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 273/574] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:22.758842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:22.759390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:22.765857 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.766175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.766988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:22.767459 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:22.911147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:22.918531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6e6352a-3f57-4411-b564-3e3aa2281225 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.163577 Apr 05 11:37:22.919098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 302/575] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:22 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:23.110263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:23.110900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:23.117671 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.118129 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.118918 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.119358 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.150110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:23.150723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:23.160488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.160952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.164232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.164232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.228999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:23.237660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7ef0fb5-4768-48dd-a472-7d7966656be5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1274 microversion: 2.1 time: 0.091243 Apr 05 11:37:23.238513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 303/576] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:23 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:23.274027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:23.283745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:23.285235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:23.286384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a67780dd-3a8e-417e-b8d7-a3d3e94a0e4f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1807 microversion: 2.20 time: 0.181148 Apr 05 11:37:23.286937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 274/577] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:23 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:37:23.333329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:23.333999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:23.339963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.340414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.341174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.341604 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.480957 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:23.489520 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-70abb417-362b-4087-a8a0-7ccc15e41c8c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.159892 Apr 05 11:37:23.490114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 304/578] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:23 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:23.941228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:23.941228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:23.945100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.945749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:23.946569 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:23.947010 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.254307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:24.254898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:24.260729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.261958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.262844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.265648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.265648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.269744 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-19f7977c-5b8d-454f-ae60-1f59fb698254 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.336942 Apr 05 11:37:24.272026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 275/579] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:23 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:24.304877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:24.305483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:24.311943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.312400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.313181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.313620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.333996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.344021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18247adf-8b9a-4f17-9e72-98b8eeee544c tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1272 microversion: 2.1 time: 0.093544 Apr 05 11:37:24.345042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 305/580] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:24 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:24.506955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:24.507527 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:24.513344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.513799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.514587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:24.515081 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:24.598985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.607675 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.609944 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.611107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-79c00656-013d-4efa-ae72-5181c009ec63 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1794 microversion: 2.20 time: 0.310283 Apr 05 11:37:24.623964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 276/581] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:37:24 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1794 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:37:24.652897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:24.660837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2569ae1b-1220-400d-97a9-3159ac0c1702 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.158576 Apr 05 11:37:24.661409 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 306/582] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:24 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:25.288629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:25.289238 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:25.296747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.297218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.298040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.298477 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.362911 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:25.363762 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:25.370209 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.370782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.371675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.372338 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.515869 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:25.523080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:25.524702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d01caf18-9e7e-447d-95b4-8542704dcd1a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.167077 Apr 05 11:37:25.526658 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 307/583] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:25 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:25.531922 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c74fa76b-023f-435f-b61b-e73dc7dea4be tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.247084 Apr 05 11:37:25.532595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 277/584] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:25 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:25.676914 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:25.677523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:25.683448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.683902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.684665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.685099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.722948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-6b200728-28bd-43eb-be27-e2a145e7de81 req-e4b216e2-d9c6-46c5-983d-d7d9313f901f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5755f95-ae09-4013-95fa-5c5c23822f8e", "tag": "f15f7201-ad36-4a4e-ace1-dd911c738dae"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:25.738379 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-6b200728-28bd-43eb-be27-e2a145e7de81 req-e4b216e2-d9c6-46c5-983d-d7d9313f901f service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:25.738975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-6b200728-28bd-43eb-be27-e2a145e7de81 req-e4b216e2-d9c6-46c5-983d-d7d9313f901f service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:25.752346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-6b200728-28bd-43eb-be27-e2a145e7de81 req-e4b216e2-d9c6-46c5-983d-d7d9313f901f service nova] Creating event network-changed:f15f7201-ad36-4a4e-ace1-dd911c738dae for instance d5755f95-ae09-4013-95fa-5c5c23822f8e on hv-cinder-83444 Apr 05 11:37:25.757328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-6b200728-28bd-43eb-be27-e2a145e7de81 req-e4b216e2-d9c6-46c5-983d-d7d9313f901f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038109 Apr 05 11:37:25.758012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 278/585] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:37:25.828089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:25.835497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e05272d6-7faf-489f-bce6-e762b8768ecf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.162472 Apr 05 11:37:25.836077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 308/586] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:25 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:26.542879 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:26.543590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:26.549897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:26.550408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.550519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:26.550859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.551665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.552098 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.556692 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.557130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.557883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.558503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.697691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:26.698258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:26.705728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-983ebdef-fdb9-4b5a-875c-53f3155b9f1e tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.167408 Apr 05 11:37:26.709740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 279/587] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:26 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:26.709861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1b45c0f2-431b-46aa-8d5b-6540877954bd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.161846 Apr 05 11:37:26.709861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 309/588] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:26 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:26.852310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:26.852910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:26.859620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.867353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.867353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:26.867353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:26.993999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:27.001294 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9990b6fd-c564-462c-a632-88ee860af734 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.152932 Apr 05 11:37:27.001860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 280/589] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:26 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:27.722805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:27.723398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:27.723821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:27.724039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:27.729778 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:27.730227 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:27.730361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:27.730679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:27.730993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:27.731437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:27.731533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:27.731902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:27.868320 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:27.871018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:27.876040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d1ca7abb-7a1b-4841-ae21-f2f9cab5ac08 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.156376 Apr 05 11:37:27.876613 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 281/590] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:27 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:27.879004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0987af8-bdcd-4acf-853a-f96f70bdfc38 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.160067 Apr 05 11:37:27.879838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 310/591] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:27 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:28.018648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:28.019257 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:28.025080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.025525 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.026283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.026751 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.169026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:28.177178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-dd642d22-72fb-4050-a34f-babc28da3e47 req-88b3f4f0-1eed-4e1e-b673-6c9dd8fa9f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "name": "network-vif-plugged", "status": "completed", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:28.177721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7f590417-1d72-4a4c-a907-8a37587dfa5c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.163438 Apr 05 11:37:28.179922 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 282/592] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:28 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:28.186071 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-dd642d22-72fb-4050-a34f-babc28da3e47 req-88b3f4f0-1eed-4e1e-b673-6c9dd8fa9f22 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.187304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-dd642d22-72fb-4050-a34f-babc28da3e47 req-88b3f4f0-1eed-4e1e-b673-6c9dd8fa9f22 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.198394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-dd642d22-72fb-4050-a34f-babc28da3e47 req-88b3f4f0-1eed-4e1e-b673-6c9dd8fa9f22 service nova] Creating event network-vif-plugged:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:37:28.203529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-dd642d22-72fb-4050-a34f-babc28da3e47 req-88b3f4f0-1eed-4e1e-b673-6c9dd8fa9f22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030151 Apr 05 11:37:28.204362 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 311/593] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:37:28.893326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:28.893866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:28.896171 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:28.896871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:28.900327 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.900780 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.901579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.901987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.903229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.903708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:28.904481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:28.905517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:29.036438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:29.039496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:29.044007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-835b3976-692f-4e21-8b7f-d874d2e08a4a tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.151929 Apr 05 11:37:29.044586 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 312/594] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:28 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:29.047143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bc22e015-8756-4a98-bff9-5d443804d48a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.157852 Apr 05 11:37:29.047743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 283/595] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:28 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:29.195960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:29.196517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:29.202821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:29.203268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:29.204060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:29.204493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:29.341074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:29.348728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7c7f4bf-478e-4346-bac1-0e308e87b99f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.156766 Apr 05 11:37:29.349323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 313/596] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:29 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:30.060624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:30.062419 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:30.067768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:30.068388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:30.068562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.069019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.069794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.070235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.074446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.074907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.075718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.076157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.206426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:30.209995 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:30.213968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f9e3392e-3f00-473e-95cc-c6343530d5be tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.157375 Apr 05 11:37:30.214539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 284/597] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:30 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:30.218105 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3fa2affc-2693-4204-a8f4-ce40f4b42769 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.157362 Apr 05 11:37:30.218836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 314/598] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:30 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:30.365668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:30.366222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:30.372159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.372606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.373892 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:30.374514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:30.509116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:30.516664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a21e86ba-a084-4c4c-bd4e-571d72d126d5 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1359 microversion: 2.1 time: 0.154960 Apr 05 11:37:30.517243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 285/599] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:30 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:31.231104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:31.231764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:31.235086 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:31.235723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:31.238574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.239038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.239846 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.240290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.241920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.242366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.243132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.243605 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.380050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:31.382248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:31.387864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-47c024b9-7b44-4b93-9a41-5b3002389280 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.160550 Apr 05 11:37:31.388427 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 315/600] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:31 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:31.390227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-36595a37-5148-41c8-a540-bb1cff557ace tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1676 microversion: 2.1 time: 0.159393 Apr 05 11:37:31.390790 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 286/601] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:31 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:31.533380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:31.534001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:31.540638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.541090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.541861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.542303 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.673830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:31.681255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3b89d93d-f3cb-4c5b-bd92-1640e48b6e28 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1550 microversion: 2.1 time: 0.151786 Apr 05 11:37:31.681831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 316/602] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:31 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:31.699115 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:31.702219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:31.706681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.707134 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.707971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.708409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.840292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:31.847904 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-99b2a65e-b454-46a5-bad0-4dfbb4fba1fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1550 microversion: 2.1 time: 0.152625 Apr 05 11:37:31.848485 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 287/603] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:31 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:31.863487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:31.866932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:31.867725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Searching by: {'deleted': False, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a'} {{(pid=124242) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 05 11:37:31.875096 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.875570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.876364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:31.876806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:31.967797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.multi_cell_list [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124242) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 05 11:37:32.065163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a290b3b-8f9c-4302-b742-4d7fe54b1c18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205298 Apr 05 11:37:32.065661 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 317/604] 10.222.0.60 () {58 vars in 1124 bytes} [Tue Apr 5 11:37:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:32.075936 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:32.076969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:32.086045 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.086045 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.086045 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.086429 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.203611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-32c42b01-4265-419e-8a97-8b56068bab27 req-50a02d37-5698-47f8-be10-ed63f76b3f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5755f95-ae09-4013-95fa-5c5c23822f8e", "name": "network-vif-plugged", "status": "completed", "tag": "f15f7201-ad36-4a4e-ace1-dd911c738dae"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:32.212502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-32c42b01-4265-419e-8a97-8b56068bab27 req-50a02d37-5698-47f8-be10-ed63f76b3f18 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.212939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-32c42b01-4265-419e-8a97-8b56068bab27 req-50a02d37-5698-47f8-be10-ed63f76b3f18 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.224039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-32c42b01-4265-419e-8a97-8b56068bab27 req-50a02d37-5698-47f8-be10-ed63f76b3f18 service nova] Creating event network-vif-plugged:f15f7201-ad36-4a4e-ace1-dd911c738dae for instance d5755f95-ae09-4013-95fa-5c5c23822f8e on hv-cinder-83444 Apr 05 11:37:32.227861 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:32.229188 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-32c42b01-4265-419e-8a97-8b56068bab27 req-50a02d37-5698-47f8-be10-ed63f76b3f18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030001 Apr 05 11:37:32.229736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 318/605] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:37:32.234095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-37260dab-ac90-4648-ac52-c537d703eb56 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1550 microversion: 2.1 time: 0.162236 Apr 05 11:37:32.234754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 288/606] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:32 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:32.406454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:32.407156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:32.410141 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:32.415192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:32.415327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.415327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.415543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.415971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.417521 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.417963 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.418718 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.419170 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.558954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:32.564611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:32.568803 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0330b0fd-e987-4c70-afee-ecba0e23d849 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1653 microversion: 2.1 time: 0.162484 Apr 05 11:37:32.569389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 289/607] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:32 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:32.572045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-192c896e-072a-4ceb-9ae8-f533d98727f3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.170153 Apr 05 11:37:32.572546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 319/608] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:32 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:32.585576 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f26e1b45-334a-4e35-85a5-9fc04c6dd696 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:32.591711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f26e1b45-334a-4e35-85a5-9fc04c6dd696 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.592262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f26e1b45-334a-4e35-85a5-9fc04c6dd696 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.613168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f26e1b45-334a-4e35-85a5-9fc04c6dd696 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Going to try to start instance {{(pid=124243) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 11:37:32.863911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f26e1b45-334a-4e35-85a5-9fc04c6dd696 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action" status: 202 len: 0 microversion: 2.1 time: 0.281762 Apr 05 11:37:32.864443 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 290/609] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:37:32 2022] POST /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:37:32.872470 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:32.873089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:32.879686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.880144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:32.880919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:32.881353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:33.017613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:33.025138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2f7a56bf-ebf4-4973-b287-c9e64de79677 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1662 microversion: 2.1 time: 0.156386 Apr 05 11:37:33.026072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 320/610] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:32 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:33.589985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:33.590694 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:33.596899 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:33.597351 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:33.598116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:33.598553 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:33.733952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:33.737864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-407beace-52d9-4b03-b9aa-2a13ddc9ddf3 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.152534 Apr 05 11:37:33.738497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 291/611] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:33 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:34.042121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:34.042756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:34.050240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.050686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.051596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.052031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.198215 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:34.206995 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-51ff16c0-e1cf-42fd-bcb4-a290ad7e4b16 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1662 microversion: 2.1 time: 0.168764 Apr 05 11:37:34.207601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 321/612] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:34 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:34.279462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "996bf98a-a653-4e15-8e78-4f2c8485b060"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:34.297380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:34.297380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.297380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.297380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.297744 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.754442 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:34.761064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:34.761064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.761359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.762232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:34.762615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:34.925912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:34.933314 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f21cacd5-52db-44ae-81ad-80fd850eb227 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1314 microversion: 2.1 time: 0.182985 Apr 05 11:37:34.933885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 322/613] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:34 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:35.223814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:35.224519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:35.230500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:35.230950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:35.231771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:35.232214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:35.370432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:35.378035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb365527-c6bd-4538-a71d-414902e9f050 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1662 microversion: 2.1 time: 0.158052 Apr 05 11:37:35.378610 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 323/614] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:35 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:35.435149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d637f73a-9efb-4cd7-af7a-0ba1efee0ed6 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.159450 Apr 05 11:37:35.436564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 292/615] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:37:34 2022] POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments => generated 194 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:35.951098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:35.951916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:35.958603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:35.959056 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:35.959871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:35.960348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:36.095358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:36.111302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-742cb022-3f7b-460b-8f8d-0baf25c49cd1 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1498 microversion: 2.1 time: 0.163988 Apr 05 11:37:36.111916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 324/616] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:35 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:36.395686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:36.396394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:36.402504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:36.402954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:36.403755 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:36.404770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:36.540080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:36.547689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f53ab909-7f78-4cf3-9364-88e4ce683a91 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1662 microversion: 2.1 time: 0.156742 Apr 05 11:37:36.548247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 293/617] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:36 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:37.565631 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:37.566251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:37.572384 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.572837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:37.573694 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.574308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:37.628833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:37.629347 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:37.635626 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.636069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:37.636826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.637255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:37.663059 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:37:37.708755 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:37.716112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-513f9cf3-6148-40cf-82e9-2e3a9c49d7c1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1662 microversion: 2.1 time: 0.155154 Apr 05 11:37:37.717225 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 325/618] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:37 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:37.941910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-28a095c4-2a31-4b70-b442-b6743cb7d7d5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 204 len: 0 microversion: 2.1 time: 0.316614 Apr 05 11:37:37.942514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 294/619] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:37:37 2022] DELETE /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:37:37.950863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:37.952452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:37.958522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.958985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:37.959803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:37.960245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:38.098414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:38.106216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b5a31f1-a103-4fea-af68-94297e4ab0c5 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1504 microversion: 2.1 time: 0.159198 Apr 05 11:37:38.106864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 326/620] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:37 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:38.733237 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:38.733937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:38.740647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:38.741102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:38.741876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:38.742313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:38.883809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:38.892173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9e78b99c-2b62-4875-a7bc-9824ffd4a334 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1666 microversion: 2.1 time: 0.163113 Apr 05 11:37:38.892774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 295/621] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:38 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:39.132031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:39.132623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:39.139797 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:39.140250 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:39.141021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:39.141454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:39.276646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:39.284246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-77574fc9-ce07-4eb5-bbd5-9225e9240beb tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1504 microversion: 2.1 time: 0.156083 Apr 05 11:37:39.284817 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 327/622] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:39 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:40.301205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:40.301806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:40.308230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:40.308677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:40.309426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:40.309853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:40.440896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:40.448089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-08aa2b01-783e-4134-a26f-9ed136893a68 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1504 microversion: 2.1 time: 0.150792 Apr 05 11:37:40.448654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 296/623] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:40 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:41.465791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:41.466766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:41.473572 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:41.474037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:41.480574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:41.480574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:41.540202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:41.548305 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e505e9a-76b5-46e9-b5d7-8b96453dfb15 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1462 microversion: 2.1 time: 0.086317 Apr 05 11:37:41.548904 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 328/624] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:41 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:41.758990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-2dc917d0-9328-496e-aba8-9282e2a60962 req-52121dc7-ca37-4029-ad90-ff8233c3f965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5755f95-ae09-4013-95fa-5c5c23822f8e", "name": "network-vif-deleted", "tag": "f15f7201-ad36-4a4e-ace1-dd911c738dae"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:41.768032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-2dc917d0-9328-496e-aba8-9282e2a60962 req-52121dc7-ca37-4029-ad90-ff8233c3f965 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:41.772847 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-2dc917d0-9328-496e-aba8-9282e2a60962 req-52121dc7-ca37-4029-ad90-ff8233c3f965 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:41.778918 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-2dc917d0-9328-496e-aba8-9282e2a60962 req-52121dc7-ca37-4029-ad90-ff8233c3f965 service nova] Creating event network-vif-deleted:f15f7201-ad36-4a4e-ace1-dd911c738dae for instance d5755f95-ae09-4013-95fa-5c5c23822f8e on hv-cinder-83444 Apr 05 11:37:41.784389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-2dc917d0-9328-496e-aba8-9282e2a60962 req-52121dc7-ca37-4029-ad90-ff8233c3f965 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029149 Apr 05 11:37:41.784976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 297/625] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:42.566638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:42.567246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:42.573914 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:42.574368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:42.575182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:42.575645 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:42.605691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:42.606219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:42.606685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lazy-loading 'fault' on Instance uuid d5755f95-ae09-4013-95fa-5c5c23822f8e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:37:42.646659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb3a9cf73004b289beb4fc420cbaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d646856dc44118a63f2dd56d120c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:42.654629 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a04f3766-82ff-41f2-9d66-5a44387fdd87 tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 200 len: 1304 microversion: 2.1 time: 0.091297 Apr 05 11:37:42.655337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 329/626] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:42 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:43.675161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:43.675920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] [instance: d5755f95-ae09-4013-95fa-5c5c23822f8e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:43.682305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:43.682762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:43.683582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:43.684019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:43.699028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] HTTP exception thrown: Instance d5755f95-ae09-4013-95fa-5c5c23822f8e could not be found. Apr 05 11:37:43.699659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] Returning 404 to user: Instance d5755f95-ae09-4013-95fa-5c5c23822f8e could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:37:43.700479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8ebad09b-d8a0-4c48-babb-cb3502816bbf tempest-VolumesActionsTest-1409715958 tempest-VolumesActionsTest-1409715958-project] 10.222.0.60 "GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e" status: 404 len: 111 microversion: 2.1 time: 0.031207 Apr 05 11:37:43.701069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 298/627] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:43 2022] GET /compute/v2.1/servers/d5755f95-ae09-4013-95fa-5c5c23822f8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:37:45.464877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:45.465491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:45.471949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:45.472401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:45.473177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:45.473615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:45.608827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:45.616675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df129b51-ce62-411b-bcf6-b046a4758706 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1596 microversion: 2.1 time: 0.155584 Apr 05 11:37:45.617244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 330/628] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:45 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:37:47.606765 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-ac7ce8ba-f488-493f-b890-39d81db1f859 req-56f8a443-6fa1-48cd-bd66-9f2815593f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:47.617050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-ac7ce8ba-f488-493f-b890-39d81db1f859 req-56f8a443-6fa1-48cd-bd66-9f2815593f27 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:47.617497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-ac7ce8ba-f488-493f-b890-39d81db1f859 req-56f8a443-6fa1-48cd-bd66-9f2815593f27 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:47.629164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-ac7ce8ba-f488-493f-b890-39d81db1f859 req-56f8a443-6fa1-48cd-bd66-9f2815593f27 service nova] Creating event network-changed:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:37:47.634068 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-ac7ce8ba-f488-493f-b890-39d81db1f859 req-56f8a443-6fa1-48cd-bd66-9f2815593f27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032375 Apr 05 11:37:47.635337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 299/629] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:50.285833 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-650315932"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:50.286405 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:50.293090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:50.293744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:50.295259 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:50.296178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:50.445157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.network.security_group_api [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Adding security group 6407e0af-4d09-4667-97e7-cd7a4e13bfee to port 1c450bf1-70cb-43f6-b3c7-8ca81f6a779b Apr 05 11:37:51.005866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c0f1a98-2411-46d6-be04-974ad7d5087f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action" status: 202 len: 0 microversion: 2.1 time: 0.715072 Apr 05 11:37:51.014002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 331/630] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:37:50 2022] POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:37:51.023345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-0d797b3e-e108-4894-9fd4-fb805a1f087f req-fb29c4ea-ae24-4ecf-b581-05280b943018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:51.036574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:37:51.037220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:51.050084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:51.050908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:51.051896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:51.052746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:51.061520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0d797b3e-e108-4894-9fd4-fb805a1f087f req-fb29c4ea-ae24-4ecf-b581-05280b943018 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:51.068158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0d797b3e-e108-4894-9fd4-fb805a1f087f req-fb29c4ea-ae24-4ecf-b581-05280b943018 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:51.090469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-0d797b3e-e108-4894-9fd4-fb805a1f087f req-fb29c4ea-ae24-4ecf-b581-05280b943018 service nova] Creating event network-changed:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:37:51.105329 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-0d797b3e-e108-4894-9fd4-fb805a1f087f req-fb29c4ea-ae24-4ecf-b581-05280b943018 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102588 Apr 05 11:37:51.109822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 300/631] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:37:51.253556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:37:51.262635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ee43009-1efe-4c8a-b6a5-f42a90dc53c7 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1761 microversion: 2.1 time: 0.244425 Apr 05 11:37:51.266641 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 332/632] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:37:51 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1761 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:37:53.697868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994b9053-6b79-445a-982b-5ed30ecf4946"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:37:53.699056 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:37:53.707116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:53.707593 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:53.708365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:37:53.708798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:37:54.549338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c866500e-5140-4c64-890b-492313a9ea54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.855442 Apr 05 11:37:54.550253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 301/633] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:37:53 2022] POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:38:04.276271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:04.278041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:04.285386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:04.285843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:04.286631 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:04.288007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:04.312883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'flavor' on Instance uuid 008fc123-e8f0-413c-8da8-d8057f45c0b9 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:04.656328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-13749c43-8acc-405b-bfba-6f5fafbbab1f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/action" status: 200 len: 32 microversion: 2.1 time: 0.383781 Apr 05 11:38:04.668297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 333/634] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:38:04 2022] POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:38:04.673451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:04.675282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:04.682667 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:04.683117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:04.683922 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:04.685730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:04.884152 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:04.893437 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b05bbaf6-bb09-4bbc-bd18-c4dd2d58675e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.230792 Apr 05 11:38:04.894370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 302/635] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:04 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:05.914157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:05.915031 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:05.923706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:05.924163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:05.924969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:05.925410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:06.082148 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:06.090500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e790b715-19f4-4c23-b34f-7032d4f9efd3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.182047 Apr 05 11:38:06.091719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 334/636] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:05 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:07.108839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:07.109453 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:07.115852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:07.116372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:07.117117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:07.117554 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:07.253779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:07.261750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2e5be2d8-9de2-4fc3-98cb-93cd26a96b80 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.157408 Apr 05 11:38:07.262867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 303/637] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:07 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:08.279637 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:08.286185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:08.286749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:08.287197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:08.288062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:08.288517 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:08.432615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:08.441354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-429ff4f2-14e3-46c1-8b25-6571e1179eff tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.165792 Apr 05 11:38:08.441927 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 335/638] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:08 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:09.458400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:09.459040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:09.465791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:09.465920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:09.466663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:09.467099 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:09.600563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:09.609592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0daf27de-5db8-474c-b683-dfcb5bd7612a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.154941 Apr 05 11:38:09.610154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 304/639] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:09 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:10.627234 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:10.627824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:10.634126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:10.634577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:10.635348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:10.635815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:10.766900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:10.774805 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3b8a1d33-41bb-4aaa-869d-0955faec01c1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.151497 Apr 05 11:38:10.775382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 336/640] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:10 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:11.797181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:11.797863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:11.804164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:11.804615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:11.805384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:11.805814 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:11.948607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:11.957479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7f92eecc-db0b-4422-8220-27b8c7aac513 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.169235 Apr 05 11:38:11.958250 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 305/641] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:11 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:12.974270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:12.974877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:12.981890 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:12.982512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:12.983287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:12.983756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.119246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:13.127721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9331107-1219-47f4-ac91-ea5e1f668787 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.157251 Apr 05 11:38:13.128291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 337/642] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:12 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:13.332796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:13.333351 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:13.339401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.339882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.341215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.341648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.370893 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e8d3a964-7791-487d-ac3f-b722c604be6a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments/304d4eba-4f5a-49d7-a059-e5d4f2fb57c8" status: 200 len: 194 microversion: 2.20 time: 0.042121 Apr 05 11:38:13.371601 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 306/643] 10.222.0.60 () {60 vars in 1453 bytes} [Tue Apr 5 11:38:13 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments/304d4eba-4f5a-49d7-a059-e5d4f2fb57c8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:38:13.433795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:13.434659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:13.440843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.441479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.442253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.442686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.521531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lazy-loading 'services' on Instance uuid 5f678de2-5855-469b-8c6f-c89816e9b30e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:13.785287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b0c2883-adc3-4fdb-80a4-02b16ee66a25 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments/304d4eba-4f5a-49d7-a059-e5d4f2fb57c8" status: 202 len: 0 microversion: 2.20 time: 0.355346 Apr 05 11:38:13.786141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 338/644] 10.222.0.60 () {60 vars in 1456 bytes} [Tue Apr 5 11:38:13 2022] DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments/304d4eba-4f5a-49d7-a059-e5d4f2fb57c8 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:38:13.795695 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:13.797498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:13.805536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.806113 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.806983 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:13.807519 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:13.837452 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e7dd938c-6a7b-482a-9fe3-eb923be1d56b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046752 Apr 05 11:38:13.842740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 307/645] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Apr 5 11:38:13 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:38:14.145612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:14.146231 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:14.153291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:14.153823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:14.154599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:14.155035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:14.287349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:14.295282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-081d966c-9d09-4657-bcd4-9744f85bcc17 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.153969 Apr 05 11:38:14.295904 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 339/646] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:14 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:14.849942 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:14.851007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:14.858202 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:14.858769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:14.859768 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:14.860275 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:14.889680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8e223217-3190-482d-a794-0b8df42b860d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043788 Apr 05 11:38:14.890248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 308/647] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Apr 5 11:38:14 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:38:15.313058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:15.313673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:15.319981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:15.320431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:15.321204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:15.321761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:15.476263 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:15.484993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c9933600-38a4-45ac-8c68-8792afcf999f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.176559 Apr 05 11:38:15.485571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 340/648] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:15 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:15.901356 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:15.902273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:15.909643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:15.910087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:15.910842 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:15.911269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:15.939938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-50e611e1-6dd4-4413-9847-9d36098832e1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042513 Apr 05 11:38:15.940506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 309/649] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Apr 5 11:38:15 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:15.998603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:15.999125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:16.004998 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.005455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.006223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.006662 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.030412 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:38:16.315912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b72ff55-d2a9-4cb7-9ed7-68a79655d8ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 204 len: 0 microversion: 2.20 time: 0.321111 Apr 05 11:38:16.316577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 341/650] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Apr 5 11:38:15 2022] DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:38:16.325230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:16.326011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:16.331955 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.332412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.333181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.333619 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.472648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:16.480393 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:16.482067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:16.483225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-687a82b2-1425-471f-9636-e901b07f6f48 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.162536 Apr 05 11:38:16.483824 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 310/651] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:16 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:16.502481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:16.503191 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:16.509555 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.510010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.510853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:16.511298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:16.650362 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:16.658851 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ae5496c-c849-41f0-a716-fae0f36a673e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.160555 Apr 05 11:38:16.659442 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 342/652] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:16 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:17.373943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:17.374468 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.380734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.381184 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.381951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.382391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.405593 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ea063bf8-60a8-4929-ac33-88c0c41466bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/ips" status: 200 len: 148 microversion: 2.1 time: 0.035885 Apr 05 11:38:17.406166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 311/653] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:38:17 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:17.417373 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:17.418874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.424601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.425076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.425834 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.426265 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.502270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:17.502894 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.503867 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Invalid volume: volume 881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7 is already attached to instances: 78373594-67e2-4cfc-8b01-6417123e373b Apr 05 11:38:17.504638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 400 to user: Invalid volume: volume 881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7 is already attached to instances: 78373594-67e2-4cfc-8b01-6417123e373b {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:17.505487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-848984a1-4259-4f31-946a-51db6cac1f4d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092127 Apr 05 11:38:17.506045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 343/654] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:38:17 2022] POST /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:38:17.508686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.509167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.509887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.510312 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.514146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:17.514799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.521706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.522161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.522941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.523381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.551810 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:38:17.653171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:17.661033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:17.662546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:17.663923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-095391e7-3949-42fe-b07c-7240031be5f1 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.165218 Apr 05 11:38:17.664498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 312/655] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:17 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:17.676813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:17.677499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.683431 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.684122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.685440 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.686160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.825559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:17.830832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-67faf680-d53f-4378-8a73-ea18d5f7eeb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.157688 Apr 05 11:38:17.831624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 313/656] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:17 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:17.930536 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4522f0a4-a89d-49df-b83d-c1feff7fae6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 204 len: 0 microversion: 2.1 time: 0.419663 Apr 05 11:38:17.931175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 344/657] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:38:17 2022] DELETE /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:38:17.940020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:17.940631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:17.946595 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.947036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:17.947834 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:17.948264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:18.079169 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:18.086466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f2f58df4-e8d3-47fa-b803-0216af6d572e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1679 microversion: 2.1 time: 0.150245 Apr 05 11:38:18.087036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 314/658] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:17 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:18.689165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:18.689758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:18.696349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:18.696912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:18.697791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:18.698323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:18.835059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:18.843877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:18.845372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:18.846529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8090080b-793f-41f3-a4d1-70c8ed562369 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.162804 Apr 05 11:38:18.847094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 345/659] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:18 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:18.852769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:18.853379 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:18.860566 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:18.861015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:18.861810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:18.862245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:18.996023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:19.003810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5eba6f88-7779-452c-bed7-c0dcf95ab34b tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.154775 Apr 05 11:38:19.004382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 315/660] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:18 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:19.105078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:19.106457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:19.112461 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:19.112908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:19.113710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:19.114141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:19.402099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:19.410349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8de88fc4-f19f-4c5b-a253-23931587f2df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1679 microversion: 2.1 time: 0.309041 Apr 05 11:38:19.410917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 346/661] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:19 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:19.865513 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:19.866136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:19.873318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:19.873773 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:19.874554 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:19.874988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:20.006258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:20.014377 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:20.015917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:20.017070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d803a6ea-d0ab-4cc3-9585-8b24d6e660ef tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.155571 Apr 05 11:38:20.017618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 316/662] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:19 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:20.021495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:20.022099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:20.028804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:20.029253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:20.030040 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:20.030467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:20.168365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:20.176978 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8301d963-239b-4932-84bd-646a2585ced1 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.159959 Apr 05 11:38:20.177539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 347/663] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:20 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:20.429246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:20.429905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:20.436774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:20.437222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:20.437982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:20.438412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:20.577987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:20.585231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c85632c8-4ccb-49d2-a1a0-0ca366929921 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1679 microversion: 2.1 time: 0.161530 Apr 05 11:38:20.585808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 317/664] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:20 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:21.035043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:21.035701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:21.042411 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.042856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.043653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.044090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.174270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:21.182055 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:21.184140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:21.185891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3979897f-b690-40d1-a18b-6767de98c8af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.154989 Apr 05 11:38:21.186492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 348/665] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:21 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:21.195563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:21.196176 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:21.203534 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.203992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.204763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.205207 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.338128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:21.346265 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d4854288-9d5e-4dc9-9875-415833c9e3e5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.154682 Apr 05 11:38:21.346861 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 318/666] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:21 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:21.602834 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:21.603452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:21.610239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.610686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.611464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:21.611921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:21.749211 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:21.756567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab88f449-d22d-44a7-87cd-169a2b55d7d9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1679 microversion: 2.1 time: 0.157551 Apr 05 11:38:21.757130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 349/667] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:21 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:22.204959 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:22.205558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:22.212263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.212639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.213420 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.213856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.363108 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:22.363854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:22.372748 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.373541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.374519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.374977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.529565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:22.538779 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-623c3516-1aef-4c3f-a5b9-9485570a3c7d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.179412 Apr 05 11:38:22.549187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 350/668] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:22 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:22.626181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:22.634770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:22.636430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:22.638432 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b4beca11-3704-45b7-9c7c-d2c4b871e31d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1722 microversion: 2.20 time: 0.437685 Apr 05 11:38:22.639083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 319/669] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:22 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:22.776025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:22.777126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:22.787474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.788189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.789095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:22.789786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:22.982813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:22.990686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-577604bd-6d66-4511-aada-109e8c74ee76 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1679 microversion: 2.1 time: 0.219638 Apr 05 11:38:22.991261 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 351/670] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:22 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:23.556618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:23.557153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:23.566566 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:23.577344 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:23.577344 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:23.577344 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:23.657515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:23.658143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:23.664929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:23.665384 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:23.666164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:23.666603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:23.732202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:23.740379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:23.741905 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:23.743059 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3f84d8c2-02f7-4619-a901-7da32e310572 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1655 microversion: 2.20 time: 0.089802 Apr 05 11:38:23.743649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 352/671] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:23 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:23.956625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:23.967947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d7cf1472-337a-4e0f-8a2d-19186a0d87f2 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.415200 Apr 05 11:38:23.969466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 320/672] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:23 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:24.007982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:24.008766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:24.015038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.020416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.020416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.020416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.089068 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:24.097380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4453b3d1-793f-457a-8675-300ba41a6230 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1612 microversion: 2.1 time: 0.093164 Apr 05 11:38:24.098541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 353/673] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:24 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:24.121774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-fce02c8d-19c2-4774-8934-8dec5f87b24d req-04e0d596-c350-4401-bbf4-82c7bb0f6354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f678de2-5855-469b-8c6f-c89816e9b30e", "name": "network-vif-deleted", "tag": "abe1c734-1139-400d-ab81-735a015fd662"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:24.131501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-fce02c8d-19c2-4774-8934-8dec5f87b24d req-04e0d596-c350-4401-bbf4-82c7bb0f6354 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.131954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-fce02c8d-19c2-4774-8934-8dec5f87b24d req-04e0d596-c350-4401-bbf4-82c7bb0f6354 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.144132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-fce02c8d-19c2-4774-8934-8dec5f87b24d req-04e0d596-c350-4401-bbf4-82c7bb0f6354 service nova] Creating event network-vif-deleted:abe1c734-1139-400d-ab81-735a015fd662 for instance 5f678de2-5855-469b-8c6f-c89816e9b30e on hv-cinder-83444 Apr 05 11:38:24.159675 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-fce02c8d-19c2-4774-8934-8dec5f87b24d req-04e0d596-c350-4401-bbf4-82c7bb0f6354 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Apr 05 11:38:24.162616 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 321/674] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:24.763009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:24.764417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:24.771298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.772072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.773076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.773732 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.811713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.812489 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.813164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lazy-loading 'fault' on Instance uuid 5f678de2-5855-469b-8c6f-c89816e9b30e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:24.859142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:24.882838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:24.885609 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:24.887696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2cc3f6d5-f7af-4c5f-b3dd-3047b00d4325 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 200 len: 1370 microversion: 2.20 time: 0.129373 Apr 05 11:38:24.888789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 354/675] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:24 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:24.986692 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:24.987401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:24.994380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.994835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:24.995665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:24.996711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.116383 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:25.117363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:25.128308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:25.129076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.129863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:25.130294 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.168315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:25.169116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.169801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'fault' on Instance uuid 5bd641ff-56ae-409d-bc86-8d8edb85fedb {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:25.179188 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:25.188381 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aa63d33f-95cc-4fb2-9321-19ccc4f8ebae tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.206255 Apr 05 11:38:25.192850 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 322/676] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:24 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:25.228615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:25.237438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bc8e8304-6c1c-40e5-896a-e34a7c0720f2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 200 len: 1331 microversion: 2.1 time: 0.125247 Apr 05 11:38:25.238469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 355/677] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:25 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:25.916516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:25.917215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:25.923912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:25.924442 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.925278 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:25.925804 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:25.939300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. Apr 05 11:38:25.939982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:25.940819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ae5d616c-3c09-4275-8f4a-bb39b9e4327e tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 404 len: 111 microversion: 2.20 time: 0.028650 Apr 05 11:38:25.941357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 323/678] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:25 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:38:25.950945 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-10b781e1-9b47-4ab4-8c28-fc41581492ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '.version_select at 0x7f1382a8c040>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:26.045345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-10b781e1-9b47-4ab4-8c28-fc41581492ad tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644398058" status: 204 len: 0 microversion: 2.20 time: 0.099183 Apr 05 11:38:26.045894 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 356/679] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Apr 5 11:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644398058 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:38:26.193406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-95e96148-7adb-49c2-a9bf-d1b5334cc061 req-52c54eaa-2080-4c65-b451-d47811b690e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd641ff-56ae-409d-bc86-8d8edb85fedb", "name": "network-vif-deleted", "tag": "6bedd3d0-95f4-48c4-b38a-8ecae6e627b0"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:26.203389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-95e96148-7adb-49c2-a9bf-d1b5334cc061 req-52c54eaa-2080-4c65-b451-d47811b690e3 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:26.203389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-95e96148-7adb-49c2-a9bf-d1b5334cc061 req-52c54eaa-2080-4c65-b451-d47811b690e3 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:26.211253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:26.211895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:26.215885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-95e96148-7adb-49c2-a9bf-d1b5334cc061 req-52c54eaa-2080-4c65-b451-d47811b690e3 service nova] Creating event network-vif-deleted:6bedd3d0-95f4-48c4-b38a-8ecae6e627b0 for instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb on hv-cinder-83444 Apr 05 11:38:26.219111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:26.219829 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:26.220073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-95e96148-7adb-49c2-a9bf-d1b5334cc061 req-52c54eaa-2080-4c65-b451-d47811b690e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030196 Apr 05 11:38:26.220826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 324/680] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:26.220938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:26.221051 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:26.255977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:26.256677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:26.263633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:26.264282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:26.265068 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:26.265503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:26.282708 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. Apr 05 11:38:26.284136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:26.285176 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dbfd662c-ff0b-4f4d-9b83-ce4db3ee8a3a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 404 len: 111 microversion: 2.1 time: 0.033385 Apr 05 11:38:26.289554 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 325/681] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:26 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:38:26.295194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8a8705ee-c66f-4066-8544-150354566549 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '.version_select at 0x7f13824d7af0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:26.404244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8a8705ee-c66f-4066-8544-150354566549 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522821649" status: 202 len: 0 microversion: 2.1 time: 0.112978 Apr 05 11:38:26.405288 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 326/682] 10.222.0.60 () {58 vars in 1220 bytes} [Tue Apr 5 11:38:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522821649 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:38:26.408550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:26.416705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a7a480a8-6eca-4aa1-8cb0-d34fcf329a44 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.209229 Apr 05 11:38:26.417495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 357/683] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:26 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:27.035016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: .version_select at 0x7f1382500700>, body: {"keypair": {"name": "tempest-keypair-55828146"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:27.053152 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:27.062389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:27.433581 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:27.434502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:27.441058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:27.441618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:27.442518 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:27.443074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:27.564877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:27.568796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:27.582782 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8c68686c-dfd9-4529-bd1f-b8db259f2dea tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.552401 Apr 05 11:38:27.583742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 327/684] 10.222.0.60 () {62 vars in 1198 bytes} [Tue Apr 5 11:38:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 554 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:38:27.629722 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:27.635280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:27.635803 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:27.638250 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e127b26-3438-4cfd-94cb-7eb4a053f172 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.208663 Apr 05 11:38:27.639969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 358/685] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:27 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:27.642401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:27.642860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:27.643662 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:27.646707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:27.775993 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'services' on Instance uuid 78373594-67e2-4cfc-8b01-6417123e373b {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:28.192282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-de400c56-b9a8-4c99-b2a6-d8cccc9aa920 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments/881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7" status: 202 len: 0 microversion: 2.1 time: 0.560676 Apr 05 11:38:28.192914 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 328/686] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:38:27 2022] DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments/881e0a30-dfb0-4b54-97fa-2e0ddc2c70a7 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:28.202224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:28.203192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:28.209281 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:28.209738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:28.210515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:28.211044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:28.240971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f46f4d2-c82a-426d-aae1-d6bf640f109c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Apr 05 11:38:28.241458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 359/687] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:38:28 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:28.656252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:28.657024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:28.663514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:28.663980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:28.664749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:28.665242 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:28.826066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:28.831783 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5c5a3c4c-2342-49c4-87b7-68389203c18c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1735 microversion: 2.1 time: 0.179948 Apr 05 11:38:28.832356 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 329/688] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:28 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:29.253595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:29.254532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:29.264264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:29.264264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:29.264264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:29.264264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:29.295023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-85bf35e8-e1cb-491a-a916-7ff93683e8a5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Apr 05 11:38:29.295803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 360/689] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:38:29 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:29.848976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:29.849610 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:29.856608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:29.857053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:29.857815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:29.858249 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.089736 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:30.099940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-07ad1fdc-1542-4572-9430-90d12f2f8798 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1715 microversion: 2.1 time: 0.254688 Apr 05 11:38:30.100742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 330/690] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:29 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1715 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:30.206368 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:30.206863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.212729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.213184 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.213952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.214383 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.298076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] HTTP exception thrown: Cannot 'detach_volume' instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 while it is in vm_state rescued Apr 05 11:38:30.298690 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Returning 409 to user: Cannot 'detach_volume' instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 while it is in vm_state rescued {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:30.299563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4323819-565c-4a45-b072-62ca9d5d4b54 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments/994b9053-6b79-445a-982b-5ed30ecf4946" status: 409 len: 152 microversion: 2.1 time: 0.097326 Apr 05 11:38:30.300124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 361/691] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:38:30 2022] DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments/994b9053-6b79-445a-982b-5ed30ecf4946 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:38:30.306259 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:30.307273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.308244 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:30.308847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.313916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.314433 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.315274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.315739 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.315888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.316202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.316985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.317429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.349254 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c56fe114-37fa-4af3-b9c7-c04b40b0eee3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046932 Apr 05 11:38:30.352911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 331/692] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:38:30 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:38:30.411256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:30.411941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.417801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.418284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.419058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.419523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.445461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:38:30.560245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6a63f71-0f84-4297-8fe2-19f44445fba3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/action" status: 202 len: 0 microversion: 2.1 time: 0.255516 Apr 05 11:38:30.560878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 362/693] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:38:30 2022] POST /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:30.566444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-616180712", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e75e15ad-ea96-4c51-a99a-e2b235a6dca2"}], "security_groups": [{"name": "tempest-securitygroup--1119007034"}], "key_name": "tempest-keypair-55828146", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:30.665994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] validate_networks() for [('e75e15ad-ea96-4c51-a99a-e2b235a6dca2', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:38:30.804648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1ccce0bd-45ae-4b81-bc21-0e1f1ec8716a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 204 len: 0 microversion: 2.1 time: 0.396707 Apr 05 11:38:30.805288 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 332/694] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:38:30 2022] DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:38:30.812897 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:30.814405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.820565 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.821020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.821788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.822224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.963912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:30.973459 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c6dd288c-f9d2-46d3-9ec0-626a4d6149ca tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1723 microversion: 2.1 time: 0.166016 Apr 05 11:38:30.973459 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 333/695] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:30 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:30.977395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:30.978098 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:30.984841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.985293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:30.986055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:30.986484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.057416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:38:31.057841 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:38:31.058316 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:38:31.058786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:38:31.059607 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:38:31.068254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.068700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.069493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.069923 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.086701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:31.091163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Getting quotas for user 79180da3d5fd40d78032caf8d54dbcd0 and project 233d90e8ff5e4e72ad93b7b8123f9648. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:31.102361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:38:31.104759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:38:31.122683 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:31.130130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c7156cad-640d-48bc-bcf5-8fecc6f48f49 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1681 microversion: 2.1 time: 0.156173 Apr 05 11:38:31.130743 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 334/696] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:30 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:31.272381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fe44d048-f5f1-426e-a1de-f38d4ca9fe30 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.710254 Apr 05 11:38:31.273032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 363/697] 10.222.0.60 () {62 vars in 1187 bytes} [Tue Apr 5 11:38:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 11:38:31.283239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:31.284065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:31.343390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:31.347968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:31.349492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:31.350640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4c87a136-b3a3-4656-be87-adbcfc1445fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1279 microversion: 2.20 time: 0.071410 Apr 05 11:38:31.351339 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 335/698] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:31 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1279 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:31.945061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:31.946028 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:31.954406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.958363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.958363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.958363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.990280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:31.990919 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:31.997614 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.998060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:31.998829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:31.999262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.180195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.189051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c16f4f5c-64ec-4c30-aa3a-6f68b288e5c6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1723 microversion: 2.1 time: 0.202532 Apr 05 11:38:32.193682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 336/699] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:31 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:32.194129 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:32.194732 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:32.201154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.201540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.202310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.202748 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.276596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bf289e23-9abc-4600-939d-9eeb05bdfcc2 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action" status: 202 len: 0 microversion: 2.1 time: 0.335467 Apr 05 11:38:32.277370 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 364/700] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:38:31 2022] POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:32.286116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:32.286823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:32.293137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.301102 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.301102 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.301102 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.343998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.366878 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e8cce6fd-e095-4d30-a3e4-4bf884a987bf tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1681 microversion: 2.1 time: 0.176094 Apr 05 11:38:32.367621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 337/701] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:32 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:32.374114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:32.375005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:32.382526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.383222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.384253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:32.384842 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:32.465973 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.472381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.474003 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.475532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:32.476651 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1d3826d2-ddb4-4694-a335-313753dba5fd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1283 microversion: 2.20 time: 0.107688 Apr 05 11:38:32.477229 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 338/702] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:32 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:32.482026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-25c666e2-9ddb-4490-868f-be8714b2945c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1753 microversion: 2.1 time: 0.199965 Apr 05 11:38:32.482744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 365/703] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:32 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:33.206175 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.206819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.212828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.213283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.214060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.214493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.385249 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.386473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.393611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.394337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.395279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.395749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.452395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.460715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0dc46854-6264-4b39-baa5-325c44f4fbb3 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1723 microversion: 2.1 time: 0.258337 Apr 05 11:38:33.470128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 339/704] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:33 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:33.494042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.495101 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.502064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.503258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.504457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.505181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.556090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.564252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5bdb50a-2d86-4342-a831-fee1e484edca tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1681 microversion: 2.1 time: 0.182925 Apr 05 11:38:33.564824 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 366/705] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:33 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:33.569499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.570478 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.573427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.578140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.578818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.579626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.580060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.584569 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.586079 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.587219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d3ea30fb-9f59-466d-85ca-c14e0b91d5bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1331 microversion: 2.20 time: 0.097052 Apr 05 11:38:33.587833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 340/706] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:33 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:33.593248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.594218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.600366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.600868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.601738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.602221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.630580 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-43ef0ced-5567-4a17-8e9a-c9d7b63d95cd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041620 Apr 05 11:38:33.631062 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 341/707] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:38:33 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:38:33.697077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:33.697592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:33.705977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.708230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.708230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:33.708230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:33.739487 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:38:33.755196 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:33.764685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9c6bd987-f580-4039-990a-10a5f4a3e95b tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1753 microversion: 2.1 time: 0.198830 Apr 05 11:38:33.765488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 367/708] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:33 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:33.985515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-66a300f7-ccf5-465b-860b-b7c5cae33b32 req-0847bc8d-0557-4d8d-b872-91fb904bd6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78373594-67e2-4cfc-8b01-6417123e373b", "name": "network-vif-deleted", "tag": "9aac8d4b-83d8-4a48-87aa-17a88f5ed914"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:33.999640 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-66a300f7-ccf5-465b-860b-b7c5cae33b32 req-0847bc8d-0557-4d8d-b872-91fb904bd6d2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.000089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-66a300f7-ccf5-465b-860b-b7c5cae33b32 req-0847bc8d-0557-4d8d-b872-91fb904bd6d2 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.011256 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-66a300f7-ccf5-465b-860b-b7c5cae33b32 req-0847bc8d-0557-4d8d-b872-91fb904bd6d2 service nova] Creating event network-vif-deleted:9aac8d4b-83d8-4a48-87aa-17a88f5ed914 for instance 78373594-67e2-4cfc-8b01-6417123e373b on hv-cinder-83444 Apr 05 11:38:34.018080 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-66a300f7-ccf5-465b-860b-b7c5cae33b32 req-0847bc8d-0557-4d8d-b872-91fb904bd6d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036207 Apr 05 11:38:34.018905 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 368/709] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:34.107249 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4e64219e-f8b1-4b62-ad14-5ef8f5ad8b5b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 204 len: 0 microversion: 2.1 time: 0.419319 Apr 05 11:38:34.108090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 342/710] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:38:33 2022] DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:38:34.116614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:34.117324 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:34.125074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.125584 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.126390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.126828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.268545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.275902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-911042be-4be6-4421-ba56-55a735158914 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1672 microversion: 2.1 time: 0.163491 Apr 05 11:38:34.276426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 369/711] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:34 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:34.483958 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:34.484706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:34.493291 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.494061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.494939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.495633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.582214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:34.582914 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:34.590111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.590770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.591354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.591939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.657499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.666435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7e972a7-1492-4740-8788-5d7fb5a40b03 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1613 microversion: 2.1 time: 0.087972 Apr 05 11:38:34.667326 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 370/712] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:34 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:34.682552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:34.683529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:34.690838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.691701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.692757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.693405 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.754764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.770480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-db21b26e-c31c-41e2-ae7c-b2006100e752 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1723 microversion: 2.1 time: 0.288422 Apr 05 11:38:34.770480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 343/713] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:34 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:34.770842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.777909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.779890 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.781922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ddc709d9-4bdf-4111-af1f-690a3afea59c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1331 microversion: 2.20 time: 0.102742 Apr 05 11:38:34.782661 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:34.782788 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 371/714] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:34 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:34.783510 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:34.789664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.790126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.790909 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:34.791345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:34.948398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:34.956791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aa94234b-a3d9-4324-87ff-1d55a78e2cad tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1753 microversion: 2.1 time: 0.177974 Apr 05 11:38:34.957378 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 344/715] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:34 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:35.294132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:35.294669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:35.300519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.301021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.301726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.302157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.434601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:35.442083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-057920bd-7168-43be-ac20-b240dcc7d764 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1672 microversion: 2.1 time: 0.153010 Apr 05 11:38:35.442672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 372/716] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:35 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:35.684942 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:35.685455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:35.691825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.692277 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.693042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.693477 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.741932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:35.742499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:35.748830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.749291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.750076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.750518 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.753543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:35.760836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c33bc1bd-30ef-45a5-8aa2-cf105fc538b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1326 microversion: 2.1 time: 0.080331 Apr 05 11:38:35.761406 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 345/717] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:35 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1326 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:35.773562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lazy-loading 'flavor' on Instance uuid d723380a-3b3f-4f00-b701-f76ab30add84 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:35.781345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:35.781951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:35.788002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.788466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.789269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.789706 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.926036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:35.934222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dbfa8750-f182-404d-a875-c56923b159ba tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1723 microversion: 2.1 time: 0.156809 Apr 05 11:38:35.934789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 346/718] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:35 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:35.940404 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:35.940404 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:35.945235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.945689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:35.946451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:35.946887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.006440 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.014759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.016324 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.017426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7ac82ad1-52ad-4de2-bddb-b162b37d41dc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1339 microversion: 2.20 time: 0.081723 Apr 05 11:38:36.017985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 347/719] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:35 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:36.022247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:36.022857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:36.028964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.029419 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.030190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.030629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.125709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dc26358a-ddf7-47a9-aa6d-2d34292e44a6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "POST /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84/action" status: 202 len: 0 microversion: 2.1 time: 0.387417 Apr 05 11:38:36.126337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 373/720] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:38:35 2022] POST /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:36.134603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:36.137473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:36.141771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.142225 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.143004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.143468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.175884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.184208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4be61e16-2f9f-43ef-a9cb-45406eacfeaf tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1753 microversion: 2.1 time: 0.164930 Apr 05 11:38:36.184916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 348/721] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:36 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:36.280149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.287652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-87ca708a-94e7-48ae-ac2d-0bec754ece6f tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.156965 Apr 05 11:38:36.288227 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 374/722] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:36 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:36.457965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:36.458577 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:36.465143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.465808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.466876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.467380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.664887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.672418 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a42e1db0-8cb7-4571-a548-ace023db4119 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1672 microversion: 2.1 time: 0.218151 Apr 05 11:38:36.672992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 349/723] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:36 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:36.778131 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:36.778844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:36.785218 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.785670 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.786438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.786876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.818047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.818431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.818876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'fault' on Instance uuid 78373594-67e2-4cfc-8b01-6417123e373b {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:36.858692 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:36.865973 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e15ee89-746c-4dd4-802d-59dc19829406 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1331 microversion: 2.1 time: 0.091785 Apr 05 11:38:36.866573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 375/724] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:36 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:36.951401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:36.952033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:36.958325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.958776 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:36.959572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:36.960011 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.036070 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.036680 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.042456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.043593 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.044297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.044745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.100530 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.106839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.109598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0abc4355-8842-42bd-96f8-3e139b5582c9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1729 microversion: 2.1 time: 0.161995 Apr 05 11:38:37.110186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 350/725] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:36 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:37.114989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.118128 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.118128 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b24ad1c-bdb4-4e3f-a1bc-15ac64de9406 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1339 microversion: 2.20 time: 0.085495 Apr 05 11:38:37.118513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 376/726] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:37.125863 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.126454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.132567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.133108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.133987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.134497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.201404 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.202012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.208024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.208467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.209228 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.209658 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.279883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-79a193aa-5634-48a5-9ed4-992cb9a7066c tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157609 Apr 05 11:38:37.280483 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 351/727] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:37.305236 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.306090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.313687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.314867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.315352 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.315951 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.404506 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.413220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-543eb232-e412-49cd-873e-389641f992f3 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1753 microversion: 2.1 time: 0.216290 Apr 05 11:38:37.414553 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 377/728] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:37.689277 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.690004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.696157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.697133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.697465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.697905 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.847978 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.856535 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7643ba4b-3081-4867-a903-04a0c64c156d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1672 microversion: 2.1 time: 0.171163 Apr 05 11:38:37.857316 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 378/729] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:37.883201 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:37.886501 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:37.890253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.890855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.891944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.892367 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.924337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:37.924794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:37.925260 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'fault' on Instance uuid 78373594-67e2-4cfc-8b01-6417123e373b {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:38:37.983154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:37.990757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef029fbf-3fe7-44c2-8514-7d4bcab21cef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 200 len: 1331 microversion: 2.1 time: 0.111442 Apr 05 11:38:37.991335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 379/730] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:38.022389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:38.030202 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e2dfea81-0a3b-4f65-8bdf-607af01381ee tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.728889 Apr 05 11:38:38.030778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 352/731] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:37 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:38.140235 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:38.140950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:38.148071 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.148739 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.149616 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.150113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.236013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:38.242600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:38.244228 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:38.245604 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2b6e850-92ce-475c-8cc9-a9dbe7c9b221 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1337 microversion: 2.20 time: 0.111593 Apr 05 11:38:38.246262 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 380/732] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:38 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1337 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:38.432369 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:38.433095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:38.439581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.440042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.440822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.441256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.874343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:38.874951 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:38.881278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.881738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.882482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:38.882918 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:38.931447 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:38.940458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-95cc0efd-c971-44c8-a387-3ae170aa38f1 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.512718 Apr 05 11:38:38.946732 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 353/733] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:38 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:39.008934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:39.009764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:39.017154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.017599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.018363 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.018795 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.033270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. Apr 05 11:38:39.033945 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:39.034679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fdbeeb24-7e66-4c5c-bc92-6871f1df144c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 404 len: 111 microversion: 2.1 time: 0.030773 Apr 05 11:38:39.035221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 354/734] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:39 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:38:39.042015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:39.043518 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6eeee97c-a9a2-4043-a38e-9d4110c72a26 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '.version_select at 0x7f1382425310>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:39.050554 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd189b4e-9d61-4f68-b05a-14ab82b3a717 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1672 microversion: 2.1 time: 0.180773 Apr 05 11:38:39.051541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 381/735] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:38 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:39.065761 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:39.066379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:39.072111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.072559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.073328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.073760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.143073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6eeee97c-a9a2-4043-a38e-9d4110c72a26 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611072145" status: 202 len: 0 microversion: 2.1 time: 0.103317 Apr 05 11:38:39.143792 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 355/736] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Apr 5 11:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611072145 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:38:39.264280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:39.264898 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:39.271025 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.271512 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.272491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.273190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.299153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:39.311874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-043e3ca2-0332-4588-8876-0118417ef0b0 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.249604 Apr 05 11:38:39.323975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 382/737] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:39 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:39.389958 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:39.398052 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:39.399790 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:39.401055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-36bb024c-3e95-4562-a168-7dca5e3707b8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1337 microversion: 2.20 time: 0.140796 Apr 05 11:38:39.401692 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 356/738] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:39 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:39.884337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-ae9d07c5-0158-4ea3-9445-6e7a559c1ec0 req-c119344b-0e0d-438a-8000-5b764073828b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:39.907248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ae9d07c5-0158-4ea3-9445-6e7a559c1ec0 req-c119344b-0e0d-438a-8000-5b764073828b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:39.907945 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ae9d07c5-0158-4ea3-9445-6e7a559c1ec0 req-c119344b-0e0d-438a-8000-5b764073828b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:39.930503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-ae9d07c5-0158-4ea3-9445-6e7a559c1ec0 req-c119344b-0e0d-438a-8000-5b764073828b service nova] Creating event network-changed:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:38:39.937278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-ae9d07c5-0158-4ea3-9445-6e7a559c1ec0 req-c119344b-0e0d-438a-8000-5b764073828b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076185 Apr 05 11:38:39.938012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 383/739] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:39.963461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:39.964385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:40.004610 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.008305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.010201 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.011000 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.073366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:40.074984 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:40.083516 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.084391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.085666 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.086386 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.177770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:40.189002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-84096dba-dc31-451f-8eaf-7b5b2bf51a44 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1605 microversion: 2.1 time: 0.123547 Apr 05 11:38:40.191129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 384/740] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:40 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:40.197801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: .version_select at 0x7f1382cc6dc0>, body: {"keypair": {"name": "tempest-keypair-138677751"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:40.216877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:40.222937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:40.446586 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:40.456935 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:40.472892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63e729be-3349-4601-b48e-b2703403f864 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.280288 Apr 05 11:38:40.473887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 385/741] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:38:40 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:40.491830 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:40.492793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:40.536724 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.538426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.540276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.541141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.548376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:40.563461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a97bf058-9bcc-46f1-a857-c875113adfff tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.607928 Apr 05 11:38:40.564054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 357/742] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:39 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:40.568789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:40.580328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:40.589357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.591500 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:40.592167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:40.592981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:41.091341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.099858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac5752f0-cec9-40f2-8bdf-97bae5b65a18 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.624686 Apr 05 11:38:41.104839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 386/743] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:40 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:41.152422 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.160290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.162450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.164977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-89615ae8-be6b-4a15-ab63-bcc198a5b824 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.599799 Apr 05 11:38:41.176371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 358/744] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:40 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:41.212437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:41.213268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:41.228743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:41.229467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:41.231021 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:41.231664 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:41.332283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.340816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3387777c-9543-41af-adc1-85857065116d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 200 len: 1322 microversion: 2.1 time: 0.132296 Apr 05 11:38:41.341389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 387/745] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:41 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 1322 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:41.581514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:41.582839 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:41.591788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:41.592592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:41.594029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:41.594665 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:41.877859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:41.891718 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1fa76444-eec2-4a63-aa49-e38003e3f5c8 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.314329 Apr 05 11:38:41.892833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 359/746] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:41 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:41.989656 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}, {"server_uuid": "271ec1c3-3848-4d8c-99be-ecc15be7f06f", "name": "network-vif-deleted", "tag": "42c2fac1-dd03-4da9-ac7d-dec991381e3a"}, {"name": "network-changed", "server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:42.009962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.010819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.030691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Creating event network-changed:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:38:42.031358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Creating event network-vif-deleted:42c2fac1-dd03-4da9-ac7d-dec991381e3a for instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f on hv-cinder-83444 Apr 05 11:38:42.032149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] Creating event network-changed:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:38:42.047029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-34ca6bfd-159a-44be-bcb5-e211339c6d8a req-bc81677e-7713-41eb-b780-6836b920e600 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.063802 Apr 05 11:38:42.047816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 388/747] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:38:42.123794 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:42.124524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:42.132251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.133099 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.137745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.137745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.186512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:42.187309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:42.200635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.203875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.203875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.203875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.355851 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:42.364771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:42.366352 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:42.367513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-025992ae-096f-4f6a-81bc-2f4a665ee7c9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.188156 Apr 05 11:38:42.368083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 389/748] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:42 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:42.373461 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:42.374138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:42.380746 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.381453 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.382406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.383129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.397655 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. Apr 05 11:38:42.398258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:38:42.399103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-968a609f-1d22-4e58-ac12-2360f922e1e6 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 404 len: 111 microversion: 2.1 time: 0.029936 Apr 05 11:38:42.399695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 390/749] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:42 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:38:42.407933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b762e6d6-e10a-497e-a44f-ca37ad1c2e0a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '.version_select at 0x7f1382d185e0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:42.557845 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:42.566177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-03756de9-48e6-45e5-9007-a11c2f4c3af6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.447939 Apr 05 11:38:42.566768 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 360/750] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:42 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:42.620132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b762e6d6-e10a-497e-a44f-ca37ad1c2e0a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724679694" status: 202 len: 0 microversion: 2.1 time: 0.212760 Apr 05 11:38:42.620132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 391/751] 10.222.0.60 () {58 vars in 1220 bytes} [Tue Apr 5 11:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724679694 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:42.910816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:42.912269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:42.927506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.928056 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:42.929093 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:42.929536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:43.366128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:43.374164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6a290eaa-2845-4792-8c6b-0bf09442f1b4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.468226 Apr 05 11:38:43.374745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 361/752] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:42 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:43.386652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:43.387286 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:43.395896 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:43.396361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:43.397144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:43.397590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:43.583327 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:43.584066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:43.591272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:43.591753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:43.592529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:43.592971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:43.619014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:43.628157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:43.629657 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:43.632583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-907a01c8-f07b-480b-bb59-4a7329f568b7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.250628 Apr 05 11:38:43.633164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 392/753] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:43 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:43.740808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:43.749662 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ab1192fe-e937-4043-b4d3-5257762bec5a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.170228 Apr 05 11:38:43.750251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 362/754] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:43 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:43.830923 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: .version_select at 0x7f1382abce50>, body: {"keypair": {"name": "tempest-keypair-999646338"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:43.845762 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:43.850770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:44.244077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:44.248685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:44.261570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae044f80-0128-47e0-a3ab-7289e99139d7 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.434643 Apr 05 11:38:44.262516 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 393/755] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:38:43 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:44.392267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:44.392921 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:44.399078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.399550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:44.400302 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.400731 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:44.570443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260335067", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83da91da-2a37-43a9-b807-df1a6d29d057"}], "security_groups": [{"name": "tempest-securitygroup--1989190115"}], "key_name": "tempest-keypair-138677751", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:44.664031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:44.674484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-34f46553-507a-47d9-8231-2e948850d02c tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.286585 Apr 05 11:38:44.675437 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 363/756] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:44 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:44.680340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:44.681264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:44.688390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.688919 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:44.689770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.690281 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:44.696117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] validate_networks() for [('83da91da-2a37-43a9-b807-df1a6d29d057', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:38:44.916073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:44.924158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:44.925872 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:44.927250 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ac28fbc9-376d-47ff-80ec-d7e921a5eec7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.250665 Apr 05 11:38:44.927925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 364/757] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:44 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:44.932921 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:44.933885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:44.943523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.943978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:44.944760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:44.945230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.129279 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:38:45.129704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:38:45.130360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:38:45.130775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:38:45.131185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:38:45.142000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.142454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.143259 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.143813 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.168732 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:45.172869 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:45.177169 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:45.185310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c1c5ac29-448a-4c9f-9d7b-c19f2c70aeb8 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.256018 Apr 05 11:38:45.185796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:38:45.185927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 365/758] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:44 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:45.188452 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:38:45.500424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-206cd83d-ad45-444b-8914-eac82cf87ff3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.934697 Apr 05 11:38:45.501715 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 394/759] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:38:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:38:45.511764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5786e5ef-1df9-4a42-9f60-16976b7701ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:45.516042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5786e5ef-1df9-4a42-9f60-16976b7701ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:45.577724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5786e5ef-1df9-4a42-9f60-16976b7701ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:45.584341 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5786e5ef-1df9-4a42-9f60-16976b7701ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1240 microversion: 2.1 time: 0.077016 Apr 05 11:38:45.584913 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 366/760] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:45 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:45.692941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:45.693557 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:45.700747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.701137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.701917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.702344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.909938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:45.909938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e5e13e8a-62ae-4e08-92ba-4c8f4a2e7a2d tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.200175 Apr 05 11:38:45.909938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 395/761] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:45 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:45.946089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:45.946696 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:45.953693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.954112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:45.954917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:45.955357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.095786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:46.103618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:46.105673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:46.106774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c0e799f3-ffcb-4561-a79e-6e2eef7b3fb7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.164678 Apr 05 11:38:46.107336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 367/762] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:45 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:46.202695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:46.203396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:46.212468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.212468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.212468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.212468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.603219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:46.603913 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:46.605672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:46.610919 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.611376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.612204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.612637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.614008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4aa1d3ea-e1b9-4d19-ae9b-f6b46b0b9c30 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.415690 Apr 05 11:38:46.625043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 396/763] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:46 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:46.680036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:46.688184 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-19719697-c44f-4bfa-a864-6f995dd06af2 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1244 microversion: 2.1 time: 0.089300 Apr 05 11:38:46.688673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 368/764] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:46 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:46.907133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:46.907804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:46.914094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.914542 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:46.915307 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:46.915768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.125211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:47.125816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:47.131797 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.132251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.133023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.133460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.177744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.186885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-65eced31-e33c-4e4f-8b09-5c8c6b095e9a tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.283500 Apr 05 11:38:47.187568 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 397/765] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:46 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:47.340475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.350707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.358460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.358460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b13111aa-a2ad-4a1d-9a97-77c9cfe95c67 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.233327 Apr 05 11:38:47.358460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 369/766] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:47 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:47.586381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-652152832", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cbffa01-3137-49e9-97ed-1f17fab5a300"}], "security_groups": [{"name": "tempest-securitygroup--1887509605"}], "key_name": "tempest-keypair-999646338", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:47.631931 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:47.632769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:47.639263 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.639751 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.640516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.641009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.691297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] validate_networks() for [('8cbffa01-3137-49e9-97ed-1f17fab5a300', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:38:47.781985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.789486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-39766dde-3c46-4df3-856a-920b023ec3c2 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.161352 Apr 05 11:38:47.790051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 370/767] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:47 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:47.794913 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:47.795777 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:47.802636 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.803087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.803901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:47.804333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:47.911135 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:47.918988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e7e76915-d917-4993-983f-3f370aaa8a66 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1292 microversion: 2.1 time: 0.127643 Apr 05 11:38:47.919758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 371/768] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:47 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:48.082322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:38:48.082827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:38:48.083207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:38:48.083650 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:38:48.084062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:38:48.093379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.093821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.094615 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.095048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.112753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for project 5346b36188734d548c57bb9d7d63476d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:38:48.116582 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Getting quotas for user cabbaa06864741528fb3ae510ec8c01f and project 5346b36188734d548c57bb9d7d63476d. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:38:48.128919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:38:48.130982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:38:48.203562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:48.204163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:48.210016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.210456 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.211219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.211678 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.261014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ea81d99-6184-44d5-a12b-d9d5850fb880 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678512 Apr 05 11:38:48.262807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 398/769] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:38:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:38:48.272859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-671e4fb4-cf9e-4493-8e6c-5d0df97cb2ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:48.273481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-671e4fb4-cf9e-4493-8e6c-5d0df97cb2ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:48.337312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-671e4fb4-cf9e-4493-8e6c-5d0df97cb2ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:48.346032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-671e4fb4-cf9e-4493-8e6c-5d0df97cb2ae tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1236 microversion: 2.1 time: 0.077838 Apr 05 11:38:48.346966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 399/770] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:48 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:48.372907 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:48.375963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:48.382703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.383254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.384165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.384676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.479763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:48.495303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4bd9ad32-724b-46db-ac6a-aba5fae1b848 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1758 microversion: 2.1 time: 0.295432 Apr 05 11:38:48.505083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 372/771] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:48 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1758 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:48.810557 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:48.811237 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:48.819848 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.820662 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.821998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.822648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.856350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:48.865178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:48.867116 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:48.868689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ee6ea7c8-8537-4a6a-9eeb-62e9979634c7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.500032 Apr 05 11:38:48.869425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 400/772] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:48 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:38:48.884024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-8641eaa9-ec33-4443-a832-22260bcb1356 req-ec1fc820-1c63-412b-bbc6-8f687c531652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "name": "network-vif-plugged", "status": "completed", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:48.892545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8641eaa9-ec33-4443-a832-22260bcb1356 req-ec1fc820-1c63-412b-bbc6-8f687c531652 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.892991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8641eaa9-ec33-4443-a832-22260bcb1356 req-ec1fc820-1c63-412b-bbc6-8f687c531652 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.905408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-8641eaa9-ec33-4443-a832-22260bcb1356 req-ec1fc820-1c63-412b-bbc6-8f687c531652 service nova] Creating event network-vif-plugged:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:38:48.911908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-8641eaa9-ec33-4443-a832-22260bcb1356 req-ec1fc820-1c63-412b-bbc6-8f687c531652 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 Apr 05 11:38:48.912638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 401/773] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:48.945513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:48.946160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:48.956255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.956255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:48.956255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:48.956255 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:49.034472 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:49.041880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44431a59-eb82-4c2e-b835-401dc06139ec tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1298 microversion: 2.1 time: 0.102498 Apr 05 11:38:49.043078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 402/774] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:48 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:49.080275 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:49.087742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e5204a91-0caf-4ce4-8b01-16f74e3b7695 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.285405 Apr 05 11:38:49.088398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 373/775] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:48 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:49.366043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3df6a8ec-7162-41a8-918e-55d96ca6b6fc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:49.366043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3df6a8ec-7162-41a8-918e-55d96ca6b6fc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:49.427366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3df6a8ec-7162-41a8-918e-55d96ca6b6fc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:49.427366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3df6a8ec-7162-41a8-918e-55d96ca6b6fc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1236 microversion: 2.1 time: 0.063955 Apr 05 11:38:49.427366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 403/776] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:49 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:49.513271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:49.513883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:49.519959 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:49.520409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:49.521181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:49.521672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:49.672617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:49.680317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-76ba50aa-466a-42f9-8539-36ec7cc6fb5e tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1761 microversion: 2.1 time: 0.171821 Apr 05 11:38:49.680887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 374/777] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:49 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:49.888701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:49.889225 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:49.895155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:49.895654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:49.896432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:49.896871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.030835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.038574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.040114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.041216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d0bd2c9a-62d8-41bf-9b7f-6feaba3d96b3 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.157286 Apr 05 11:38:50.041771 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 404/778] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:49 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:50.060262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:50.060878 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:50.067161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.067688 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.068458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.068897 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.106206 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:50.106828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:50.112704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.121786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.121786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.121786 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.200954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.208484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-be747c13-d939-4edd-9887-3b747819b1c9 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.152876 Apr 05 11:38:50.209151 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 375/779] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:50 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:50.251043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.258417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f06a4667-c289-45a7-b412-c20f7fe43aa5 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.156788 Apr 05 11:38:50.258994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 405/780] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:50 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:50.440261 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:50.440775 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:50.446621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.447060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.447835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:50.448260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:50.506445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:50.514286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e8f9c33c-6aef-49d5-b4c5-ea5b908df61f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1240 microversion: 2.1 time: 0.077874 Apr 05 11:38:50.514979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 376/781] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:50 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:51.063010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:51.063666 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:51.070165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.070821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.071959 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.072628 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.225758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.225960 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:51.226549 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:51.234688 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.235009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.235345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.236165 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.236599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.237180 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.238411 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98760cc2-dd54-44f2-b512-4194b4c07669 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.183075 Apr 05 11:38:51.239275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 406/782] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:51 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:51.277964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:51.278991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:51.285449 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.285901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.286688 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.287122 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.452376 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.461010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0adf7da-fa10-4b05-a91d-ad48b5871d43 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.188172 Apr 05 11:38:51.461917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 407/783] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:51 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:51.532877 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:51.533820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:51.542183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.543348 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.544425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.545365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.554274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.572110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3ab2bf55-606d-414c-a764-a1047ed1d234 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.350409 Apr 05 11:38:51.573032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 377/784] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:51 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:51.634924 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:51.638200 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17433685-45f1-4f25-aad9-ceea5496e71b tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1288 microversion: 2.1 time: 0.111829 Apr 05 11:38:51.638866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 408/785] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:51 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:51.789120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-0a4ead27-8886-4740-b68a-936d4d829b5f req-8fbe57af-a531-44ce-ab59-9a3f5e0dcfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3945b25c-4ebb-40d4-aa74-715634c40e57", "tag": "91e6a764-953d-4b1e-9902-5211db07b9b6"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:51.797685 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0a4ead27-8886-4740-b68a-936d4d829b5f req-8fbe57af-a531-44ce-ab59-9a3f5e0dcfb1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:51.798359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0a4ead27-8886-4740-b68a-936d4d829b5f req-8fbe57af-a531-44ce-ab59-9a3f5e0dcfb1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:51.812715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-0a4ead27-8886-4740-b68a-936d4d829b5f req-8fbe57af-a531-44ce-ab59-9a3f5e0dcfb1 service nova] Creating event network-changed:91e6a764-953d-4b1e-9902-5211db07b9b6 for instance 3945b25c-4ebb-40d4-aa74-715634c40e57 on hv-cinder-83444 Apr 05 11:38:51.818173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-0a4ead27-8886-4740-b68a-936d4d829b5f req-8fbe57af-a531-44ce-ab59-9a3f5e0dcfb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033088 Apr 05 11:38:51.818787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 378/786] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:52.257300 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:52.257920 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:52.264252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.266854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.266854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.266854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.399884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:52.407954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:52.409458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:52.410695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-883c9263-7d89-471f-a98c-5e8e1da10e7c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1405 microversion: 2.20 time: 0.157300 Apr 05 11:38:52.411257 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 409/787] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:52 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:52.479629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:52.481021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:52.487524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.487982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.488749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.489194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.588874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:52.590576 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:52.596591 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.603372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.604254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.604695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.655885 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:52.666853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0b1915c4-4507-4678-96f2-675aa1692312 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.191360 Apr 05 11:38:52.669987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 379/788] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:52 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:52.748345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:52.749279 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:52.757948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.759306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.760342 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:52.762954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:52.773607 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:52.782748 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3512cb03-c7d9-47d5-b04a-4018f1faff61 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.197567 Apr 05 11:38:52.783695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 410/789] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:52 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:53.117101 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:53.125282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d6afa4a-c20c-4ea2-894d-9a50aadde3fd tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1296 microversion: 2.1 time: 0.454111 Apr 05 11:38:53.126033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 380/790] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:52 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1296 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:53.429144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:53.429687 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:53.436955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.437397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.438157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.438587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.579719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:53.593892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:53.595477 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:53.596654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9371135a-a142-4a41-9b00-ac7fd8f15039 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1597 microversion: 2.20 time: 0.171546 Apr 05 11:38:53.597398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 411/791] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:38:53 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1597 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:38:53.614693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:53.616243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:53.622348 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.622800 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.623652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.624087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.686889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:53.687428 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:53.693142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.693589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.694356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.694788 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.712118 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3383276f-498f-4ba7-b78d-96aef43805f8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101290 Apr 05 11:38:53.712715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 381/792] 10.222.0.60 () {60 vars in 1315 bytes} [Tue Apr 5 11:38:53 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:38:53.800596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:53.801461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:53.809310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.809819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.810604 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.811037 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.841992 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:53.849944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28370bfe-29ab-4f94-b91b-abd60a00fb45 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1571 microversion: 2.1 time: 0.167768 Apr 05 11:38:53.852932 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 412/793] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:53 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:53.866549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:53.867380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:53.875721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.876333 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:53.877160 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:53.877604 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.246470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:54.254118 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f4f9b989-9535-456b-ba4c-20caff9ee78f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.457821 Apr 05 11:38:54.254779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 382/794] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:53 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:54.259374 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:54.259994 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:54.266207 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:54.266654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.267631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:54.268070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.392722 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:54.403985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5d62c8be-de8c-4e98-bf9f-a960b40e0cb0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1294 microversion: 2.1 time: 0.147675 Apr 05 11:38:54.404871 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 383/795] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:54 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:54.428993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-663473e7-2d70-4760-9778-dc546d3a4339 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "POST /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84/action" status: 202 len: 0 microversion: 2.1 time: 0.566426 Apr 05 11:38:54.429759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 413/796] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:38:53 2022] POST /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:38:54.442383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:54.443073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:54.449526 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:54.449985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.450877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:54.451225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.649888 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-1177efa6-c5e6-4fd5-a3e5-a82741ef6b91 req-04e9ebf7-78e4-4288-96c4-63700bb9a2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "name": "network-vif-unplugged", "status": "completed", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:54.660401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1177efa6-c5e6-4fd5-a3e5-a82741ef6b91 req-04e9ebf7-78e4-4288-96c4-63700bb9a2ad service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:54.660930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1177efa6-c5e6-4fd5-a3e5-a82741ef6b91 req-04e9ebf7-78e4-4288-96c4-63700bb9a2ad service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:54.672119 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.compute.server_external_events [req-1177efa6-c5e6-4fd5-a3e5-a82741ef6b91 req-04e9ebf7-78e4-4288-96c4-63700bb9a2ad service nova] Unable to find a host for instance d723380a-3b3f-4f00-b701-f76ab30add84. Dropping event network-vif-unplugged {{(pid=124242) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 05 11:38:54.673025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-1177efa6-c5e6-4fd5-a3e5-a82741ef6b91 req-04e9ebf7-78e4-4288-96c4-63700bb9a2ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027024 Apr 05 11:38:54.676724 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 414/797] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 05 11:38:54.994634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:55.003051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e80e52ff-0873-439f-a7cd-02795d60c5f3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1519 microversion: 2.1 time: 0.564462 Apr 05 11:38:55.016714 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 384/798] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:54 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:55.273186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:55.273772 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:55.282072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:55.282623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:55.283454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:55.284140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:55.435952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:55.436890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:55.443009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:55.443490 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:55.444513 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:55.444952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:55.460497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:55.471707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-19f54238-9a23-45a3-b882-2ead92c005c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.203323 Apr 05 11:38:55.472749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 415/799] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:55 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:55.565503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:55.572940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a0faf906-30fd-4d5d-bb60-f662338a6014 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1294 microversion: 2.1 time: 0.141112 Apr 05 11:38:55.573512 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 385/800] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:55 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1294 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:55.880860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-e5dd1c91-e78d-4855-8cb6-aca0838d382f req-ca41b2dd-bd14-49c9-a243-16ba380391ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:55.889587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e5dd1c91-e78d-4855-8cb6-aca0838d382f req-ca41b2dd-bd14-49c9-a243-16ba380391ad service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:55.890041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e5dd1c91-e78d-4855-8cb6-aca0838d382f req-ca41b2dd-bd14-49c9-a243-16ba380391ad service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:55.900948 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-e5dd1c91-e78d-4855-8cb6-aca0838d382f req-ca41b2dd-bd14-49c9-a243-16ba380391ad service nova] Creating event network-changed:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:38:55.906224 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-e5dd1c91-e78d-4855-8cb6-aca0838d382f req-ca41b2dd-bd14-49c9-a243-16ba380391ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028934 Apr 05 11:38:55.906897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 416/801] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:38:56.019607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:56.020225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:56.027161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.028022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.028389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.028891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.174319 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:56.181677 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6e89d642-aaa7-41ce-8579-5fe5345824d1 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1521 microversion: 2.1 time: 0.166040 Apr 05 11:38:56.182252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 386/802] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:56 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:56.488978 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:56.489831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:56.496237 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.496700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.497466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.497898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.590673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:56.591284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:56.597446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.598104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.598882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:56.599318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:56.633253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:56.642681 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4cda625a-75f6-404f-860e-8d575f0cd08a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.158041 Apr 05 11:38:56.643276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 417/803] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:56 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:56.739271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:56.746970 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7887c8ed-9de8-4cf4-b16d-26ac65110dc3 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.160710 Apr 05 11:38:56.747598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 387/804] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:56 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:57.200373 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:57.200963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:57.207741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.213443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.213443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.213443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.350208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:57.361447 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-441608bb-a3a3-4129-8328-7f1c2b39d211 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1521 microversion: 2.1 time: 0.165805 Apr 05 11:38:57.362045 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 418/805] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:57 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:57.659876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:57.660501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:57.680316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.680316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.680316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.680316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.764909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:57.768240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:57.773729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.774296 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.775204 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.775737 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:57.935896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:57.954348 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b69b5a73-5b98-465f-800f-829efb3f0cee tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.296397 Apr 05 11:38:57.954642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 388/806] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:57 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:57.978267 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:57.984823 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-47645f60-728e-4388-b906-1aa31bf4f1f9 req-7e3c8f33-b4a9-4097-b968-273664e76549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b5b208-b301-4cff-a73e-af0e1a97afc6", "tag": "5c5e83d8-b424-46aa-b736-6580c02b211f"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:38:57.989043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88ace2e4-8098-47cd-9038-a04dc31cb121 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.228478 Apr 05 11:38:57.989269 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 419/807] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:57 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:57.994269 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-47645f60-728e-4388-b906-1aa31bf4f1f9 req-7e3c8f33-b4a9-4097-b968-273664e76549 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:57.994713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-47645f60-728e-4388-b906-1aa31bf4f1f9 req-7e3c8f33-b4a9-4097-b968-273664e76549 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:58.010240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-47645f60-728e-4388-b906-1aa31bf4f1f9 req-7e3c8f33-b4a9-4097-b968-273664e76549 service nova] Creating event network-changed:5c5e83d8-b424-46aa-b736-6580c02b211f for instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 on hv-cinder-83444 Apr 05 11:38:58.017258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-47645f60-728e-4388-b906-1aa31bf4f1f9 req-7e3c8f33-b4a9-4097-b968-273664e76549 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039095 Apr 05 11:38:58.018321 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 389/808] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:38:58.378094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:58.378747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:58.385369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:58.385827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:58.387430 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:58.387887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:58.526049 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:58.534423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d471c40c-6e4c-4f4a-9d15-d4baf2984b1d tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1521 microversion: 2.1 time: 0.160198 Apr 05 11:38:58.535011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 420/809] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:58 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:58.972061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:58.972759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:58.978846 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:58.979298 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:58.981133 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:58.981570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:59.005567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:59.006181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:59.013054 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:59.013532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:59.014520 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:59.014954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:59.157731 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:59.165144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ee42b4a-b475-4d13-aede-47667433726c tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.163564 Apr 05 11:38:59.170942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 421/810] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:59 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:38:59.171751 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:59.179409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0491fc51-1521-4cf2-9e7b-49b96f0a4a8d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.212252 Apr 05 11:38:59.180240 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 390/811] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:58 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:38:59.552656 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:38:59.553268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:38:59.560147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:59.560599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:59.561365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:38:59.561803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:38:59.695637 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:38:59.704146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-00bb767c-f362-44e9-a2e5-2cfbb7136115 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.155325 Apr 05 11:38:59.704725 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 422/812] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:38:59 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:00.182140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:00.183317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:00.189969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.190429 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.191544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.191694 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.197158 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:00.197776 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:00.204182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.204627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.205406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.205841 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.346792 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:00.354481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd32ec5b-6ffb-4564-98f6-06f9740e2cc7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.161106 Apr 05 11:39:00.355197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 423/813] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:00 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:00.405720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:00.413137 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8c78f6db-a31e-44c5-9afd-23c9828674fe tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.234843 Apr 05 11:39:00.413802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 391/814] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:00 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:00.721266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:00.725175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:00.728349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.728809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.730130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.731023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.828716 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-c509e1cd-3650-4322-805e-086c28925dea req-fb10e18e-2fdc-4c13-8d86-52263b3479d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3945b25c-4ebb-40d4-aa74-715634c40e57", "name": "network-vif-plugged", "status": "completed", "tag": "91e6a764-953d-4b1e-9902-5211db07b9b6"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:00.842024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-c509e1cd-3650-4322-805e-086c28925dea req-fb10e18e-2fdc-4c13-8d86-52263b3479d9 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:00.842986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-c509e1cd-3650-4322-805e-086c28925dea req-fb10e18e-2fdc-4c13-8d86-52263b3479d9 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:00.856147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-c509e1cd-3650-4322-805e-086c28925dea req-fb10e18e-2fdc-4c13-8d86-52263b3479d9 service nova] Creating event network-vif-plugged:91e6a764-953d-4b1e-9902-5211db07b9b6 for instance 3945b25c-4ebb-40d4-aa74-715634c40e57 on hv-cinder-83444 Apr 05 11:39:00.861276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-c509e1cd-3650-4322-805e-086c28925dea req-fb10e18e-2fdc-4c13-8d86-52263b3479d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045498 Apr 05 11:39:00.861882 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 392/815] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:39:00.879439 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:00.887111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5552a01d-79af-4208-b60e-0002ab687038 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.169825 Apr 05 11:39:00.887714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 424/816] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:00 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:01.372566 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:01.373267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:01.379448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.379909 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:01.380674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.381112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:01.430273 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:01.431012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:01.438100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.438545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:01.439425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.439875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:01.524154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:01.532524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7608c9bd-342f-4d42-bcb4-01dbbfd2f751 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.164345 Apr 05 11:39:01.533100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 393/817] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:01 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:01.577079 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:01.584612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3bd10d7e-1c6c-4b41-8bfd-55c34133952e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.158355 Apr 05 11:39:01.585185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 425/818] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:01 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:01.904141 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:01.904736 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:01.910816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.911264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:01.912053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:01.912484 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:02.044927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:02.052321 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-543c9867-5c89-48bd-8d29-3f6089d35199 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.152143 Apr 05 11:39:02.052889 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 394/819] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:01 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:02.550976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:02.551664 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:02.558934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:02.559388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:02.560203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:02.560687 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:02.601783 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:02.602570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:02.613518 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:02.614360 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:02.615311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:02.616084 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:02.731463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:02.740889 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af74f07a-e4a6-45fd-a8cf-683d61f483c0 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1366 microversion: 2.1 time: 0.194891 Apr 05 11:39:02.741690 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 426/820] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:02 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:02.785338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:02.798179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d08cb59d-5c67-4bad-a6a7-40d32a8151f0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.200221 Apr 05 11:39:02.803132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 395/821] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:02 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:03.070318 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:03.071034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:03.078571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.079028 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.079848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.080295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.241585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:03.252435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fb48f9b-3ec7-4cd8-8747-0d30f57d4671 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.186427 Apr 05 11:39:03.253035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 427/822] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:03 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:03.758852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:03.759479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:03.766197 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.766649 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.768030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.768481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.814985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:03.815712 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:03.822170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.822623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.824103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.824519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.904943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:03.912572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-05f1dc75-394f-4b4e-aab3-4b6785b62d37 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1556 microversion: 2.1 time: 0.157679 Apr 05 11:39:03.913145 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 396/823] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:03 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:03.929320 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:03.929837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:03.936421 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.936875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.937648 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:03.938107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:03.964790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:03.972308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-828c521e-4247-4ac6-afaf-7bdb0e974c40 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.161188 Apr 05 11:39:03.972887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 428/824] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:03 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:04.021088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0e4f84c2-66a5-4e3b-b7b1-cacaae279253 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095693 Apr 05 11:39:04.021690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 397/825] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:39:03 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:39:04.270882 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:04.271443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:04.277331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:04.277790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:04.278686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:04.279054 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:04.416591 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:04.425007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-23dff6aa-ff4b-4909-b0e9-a7d734848cc3 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.158211 Apr 05 11:39:04.425602 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 429/826] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:04 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:04.980953 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-542a2d12-8afb-4e83-b9a5-bd0e502590a7 req-009e58c0-9c9f-49e2-bc54-bd98e7c96fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b5b208-b301-4cff-a73e-af0e1a97afc6", "name": "network-vif-plugged", "status": "completed", "tag": "5c5e83d8-b424-46aa-b736-6580c02b211f"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:04.989046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:04.989651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:04.994488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-542a2d12-8afb-4e83-b9a5-bd0e502590a7 req-009e58c0-9c9f-49e2-bc54-bd98e7c96fc0 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:04.995192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-542a2d12-8afb-4e83-b9a5-bd0e502590a7 req-009e58c0-9c9f-49e2-bc54-bd98e7c96fc0 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:04.995563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:04.996030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:04.996871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:04.997309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:05.011542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-542a2d12-8afb-4e83-b9a5-bd0e502590a7 req-009e58c0-9c9f-49e2-bc54-bd98e7c96fc0 service nova] Creating event network-vif-plugged:5c5e83d8-b424-46aa-b736-6580c02b211f for instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 on hv-cinder-83444 Apr 05 11:39:05.018002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-542a2d12-8afb-4e83-b9a5-bd0e502590a7 req-009e58c0-9c9f-49e2-bc54-bd98e7c96fc0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043545 Apr 05 11:39:05.018608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 398/827] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:05.166491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:05.174034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e8fa875-73ee-49c3-aeec-3e0b4198da86 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.189187 Apr 05 11:39:05.174620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 430/828] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:04 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:05.375661 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-25168256-6fa8-4f0d-b9e1-f494813f8c34 req-294da2a8-94f9-4347-b513-a7f93844f982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3945b25c-4ebb-40d4-aa74-715634c40e57", "tag": "91e6a764-953d-4b1e-9902-5211db07b9b6"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:05.384236 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-25168256-6fa8-4f0d-b9e1-f494813f8c34 req-294da2a8-94f9-4347-b513-a7f93844f982 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:05.384738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-25168256-6fa8-4f0d-b9e1-f494813f8c34 req-294da2a8-94f9-4347-b513-a7f93844f982 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:05.396985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-25168256-6fa8-4f0d-b9e1-f494813f8c34 req-294da2a8-94f9-4347-b513-a7f93844f982 service nova] Creating event network-changed:91e6a764-953d-4b1e-9902-5211db07b9b6 for instance 3945b25c-4ebb-40d4-aa74-715634c40e57 on hv-cinder-83444 Apr 05 11:39:05.404531 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-25168256-6fa8-4f0d-b9e1-f494813f8c34 req-294da2a8-94f9-4347-b513-a7f93844f982 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034994 Apr 05 11:39:05.405724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 399/829] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:05.442789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:05.443460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:05.450066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:05.450506 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:05.451529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:05.451977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:05.595742 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:05.603110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-48b5802b-3ae5-4100-8eb4-f9f8c06f3249 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.164227 Apr 05 11:39:05.603727 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 431/830] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:05 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:05.759805 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:39:05.760019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:39:06.192273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:06.192966 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:06.199977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:06.200452 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:06.201210 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:06.201639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:06.341012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:06.348445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aec62240-b2cd-4736-91cb-0eca6ca40983 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.160331 Apr 05 11:39:06.349026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 400/831] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:06 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:06.621964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:06.622593 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:06.629130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:06.629611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:06.630379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:06.630820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:06.768397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:06.776036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ffc31671-70bc-4a51-a697-d98a46e4c01a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.159448 Apr 05 11:39:06.776603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 432/832] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:06 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:07.365697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:07.366311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:07.373272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:07.373775 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:07.374491 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:07.374938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:07.504272 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:07.511399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b680239a-d816-4c23-9ebd-5ff530d3d8aa tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1362 microversion: 2.1 time: 0.149532 Apr 05 11:39:07.512076 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 401/833] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:07 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:07.794933 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:07.796201 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:07.802722 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:07.803198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:07.804032 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:07.804465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:07.940548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:07.947792 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3cf896c-a5ab-4eb1-80bf-501cd89df35b tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.157376 Apr 05 11:39:07.948425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 433/834] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:07 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:08.528929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:08.529532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:08.535980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.536426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:08.537185 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.537615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:08.672225 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:08.679842 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d59e8f81-bcbf-47ec-a109-43f3acd29daf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1548 microversion: 2.1 time: 0.154997 Apr 05 11:39:08.680444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 402/835] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:08 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:08.696601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:08.698550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:08.704263 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.704721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:08.705494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.705927 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:08.788468 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e74abe5-5513-46d4-80bd-b4ec3ebb6ecc tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095658 Apr 05 11:39:08.793967 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 434/836] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:39:08 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:08.966220 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:08.966857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:08.972663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.973114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:08.973875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:08.974311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:09.111296 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:09.119055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-feecc623-1875-4f3e-9e32-95f27ccd6050 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.157286 Apr 05 11:39:09.119884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 403/837] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:08 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:09.942373 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-5365c32a-34f6-455c-a430-823496bef515 req-f2b22878-9f44-40b3-84de-589d0b6ed3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b5b208-b301-4cff-a73e-af0e1a97afc6", "tag": "5c5e83d8-b424-46aa-b736-6580c02b211f"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:09.950346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5365c32a-34f6-455c-a430-823496bef515 req-f2b22878-9f44-40b3-84de-589d0b6ed3d6 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:09.950796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5365c32a-34f6-455c-a430-823496bef515 req-f2b22878-9f44-40b3-84de-589d0b6ed3d6 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:09.962143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-5365c32a-34f6-455c-a430-823496bef515 req-f2b22878-9f44-40b3-84de-589d0b6ed3d6 service nova] Creating event network-changed:5c5e83d8-b424-46aa-b736-6580c02b211f for instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 on hv-cinder-83444 Apr 05 11:39:09.967697 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-5365c32a-34f6-455c-a430-823496bef515 req-f2b22878-9f44-40b3-84de-589d0b6ed3d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088360 Apr 05 11:39:09.968297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 435/838] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:10.136663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:10.137304 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:10.144383 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:10.144836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:10.145617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:10.146371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:10.393173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:10.403489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-98256a4f-8851-457f-8890-0e87493e2149 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.270619 Apr 05 11:39:10.404864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 404/839] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:10 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:10.962775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-5db39292-898f-4cd3-9752-659c19d4cd3b req-74cf9265-ce6f-46df-98ae-04bef4ddb01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "name": "network-vif-plugged", "status": "completed", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:10.972071 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5db39292-898f-4cd3-9752-659c19d4cd3b req-74cf9265-ce6f-46df-98ae-04bef4ddb01d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:10.972522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5db39292-898f-4cd3-9752-659c19d4cd3b req-74cf9265-ce6f-46df-98ae-04bef4ddb01d service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:10.984310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-5db39292-898f-4cd3-9752-659c19d4cd3b req-74cf9265-ce6f-46df-98ae-04bef4ddb01d service nova] Creating event network-vif-plugged:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:39:10.989309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-5db39292-898f-4cd3-9752-659c19d4cd3b req-74cf9265-ce6f-46df-98ae-04bef4ddb01d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031482 Apr 05 11:39:10.990183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 436/840] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:11.421805 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:11.423634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:11.430605 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:11.431057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:11.431866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:11.432308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:11.581728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:11.589110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8dd0af2d-4016-4864-98c6-db1e5cc7e54a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.172652 Apr 05 11:39:11.590242 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 405/841] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:11 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:12.225796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:12.226387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:12.232865 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.233323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.234097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.234540 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.313476 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'services' on Instance uuid 008fc123-e8f0-413c-8da8-d8057f45c0b9 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:12.532837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7b2bb2f-70d1-4133-ad84-47641bd2b739 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments/994b9053-6b79-445a-982b-5ed30ecf4946" status: 202 len: 0 microversion: 2.1 time: 0.311134 Apr 05 11:39:12.533695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 437/842] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:39:12 2022] DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments/994b9053-6b79-445a-982b-5ed30ecf4946 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:39:12.542063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:12.543051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:12.549935 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.550384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.551151 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.551612 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.580211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8f2f8bef-d07f-428b-b441-276e01ac4594 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Apr 05 11:39:12.580768 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 406/843] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:12 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:12.607320 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:12.608075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:12.614228 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.614682 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.615481 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:12.616014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:12.757546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:12.768135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-00ab9591-2ad2-41aa-a90f-2524ac7c1e80 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1577 microversion: 2.1 time: 0.164470 Apr 05 11:39:12.768135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 438/844] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:12 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:13.592239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:13.593155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:13.599486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:13.599936 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:13.600691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:13.601119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:13.629040 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4c6d688f-4db4-4800-b3b5-003a772e08a6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Apr 05 11:39:13.629592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 407/845] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:13 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:13.787698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:13.787698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:13.790718 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:13.791181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:13.791985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:13.792430 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:13.929500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:13.938393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-10211494-3ec1-4220-a853-26083192e08c tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1564 microversion: 2.1 time: 0.158700 Apr 05 11:39:13.938964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 439/846] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:13 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:14.641333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:14.642204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:14.648703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:14.649160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:14.649965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:14.650405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:14.679095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c3436de5-6b9b-433a-91b2-c0e3d15a8823 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Apr 05 11:39:14.679684 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 408/847] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:14 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:15.690940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:15.691957 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:15.698577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:15.699034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:15.699839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:15.700278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:15.730141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ea130b5-a437-468b-b3b7-9bfb63ad5acf tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043171 Apr 05 11:39:15.730698 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 440/848] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:15 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:39:15.805090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:15.805588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:15.813023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:15.813478 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:15.814245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:15.814689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:15.838431 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:39:16.356049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c9d7e160-25a5-4bcd-9009-812ce2551076 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 204 len: 0 microversion: 2.1 time: 0.554913 Apr 05 11:39:16.356634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 409/849] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:39:15 2022] DELETE /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:39:16.365845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:16.366462 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:16.374037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:16.378340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:16.378340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:16.378340 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:16.507598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:16.515790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28e74259-8283-4576-8477-37187c0dfc91 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1689 microversion: 2.1 time: 0.153837 Apr 05 11:39:16.516361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 441/850] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:16 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:17.534400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:17.535095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:17.541389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:17.541837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:17.542597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:17.543022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:17.676978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:17.684695 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3b77fd44-8638-4cbf-b03f-addb2459816f tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1689 microversion: 2.1 time: 0.154740 Apr 05 11:39:17.685481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 410/851] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:17 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:18.701809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:18.702434 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:18.708823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:18.709280 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:18.710053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:18.710494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:18.845421 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:18.856938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d1e8fbb-a905-441d-95db-1dd0d160e1e4 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1689 microversion: 2.1 time: 0.158678 Apr 05 11:39:18.857995 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 442/852] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:18 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:19.874470 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:19.875064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:19.882791 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:19.883248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:19.884048 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:19.884485 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:20.016888 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:20.024399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-711a8c1d-b367-475e-8ee0-5be621c82800 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1689 microversion: 2.1 time: 0.154320 Apr 05 11:39:20.024959 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 411/853] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:19 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:21.041531 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:21.042172 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:21.049315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:21.049801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:21.050590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:21.051027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:21.184556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:21.192145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-772b030d-91a9-4973-afeb-e121ecb57cb5 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1689 microversion: 2.1 time: 0.154463 Apr 05 11:39:21.192728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 443/854] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:21 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:21.724256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-9265b63b-b1a5-421f-89bc-9def5cbb85cf req-172c1397-09fe-4181-9063-f5bfb1f0b8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008fc123-e8f0-413c-8da8-d8057f45c0b9", "name": "network-vif-deleted", "tag": "58614d08-35a9-4fc5-87b1-2d61b40de959"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:21.734116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9265b63b-b1a5-421f-89bc-9def5cbb85cf req-172c1397-09fe-4181-9063-f5bfb1f0b8af service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:21.734734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9265b63b-b1a5-421f-89bc-9def5cbb85cf req-172c1397-09fe-4181-9063-f5bfb1f0b8af service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:21.748880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-9265b63b-b1a5-421f-89bc-9def5cbb85cf req-172c1397-09fe-4181-9063-f5bfb1f0b8af service nova] Creating event network-vif-deleted:58614d08-35a9-4fc5-87b1-2d61b40de959 for instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 on hv-cinder-83444 Apr 05 11:39:21.754979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-9265b63b-b1a5-421f-89bc-9def5cbb85cf req-172c1397-09fe-4181-9063-f5bfb1f0b8af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090920 Apr 05 11:39:21.755941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 412/855] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:22.209598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:22.210193 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:22.217161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:22.217620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:22.218403 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:22.218842 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:22.248447 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:22.248894 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:22.249342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'fault' on Instance uuid 008fc123-e8f0-413c-8da8-d8057f45c0b9 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:22.289466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:22.297714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d451dbcf-ce15-4f9b-8d0a-44d16c415ed9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 200 len: 1334 microversion: 2.1 time: 0.092055 Apr 05 11:39:22.298285 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 444/856] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:22 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:23.315314 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:23.316087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 008fc123-e8f0-413c-8da8-d8057f45c0b9] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:23.322223 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:23.322701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:23.323501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:23.323946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:23.336735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] HTTP exception thrown: Instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 could not be found. Apr 05 11:39:23.337313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Returning 404 to user: Instance 008fc123-e8f0-413c-8da8-d8057f45c0b9 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:23.338136 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-150b0c04-852d-4c36-8171-33d32969d2cd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9" status: 404 len: 111 microversion: 2.1 time: 0.027613 Apr 05 11:39:23.338660 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 413/857] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:23 2022] GET /compute/v2.1/servers/008fc123-e8f0-413c-8da8-d8057f45c0b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:39:23.347673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a13241c-b5bf-4f03-95d3-0dfa5d74a2b9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '.version_select at 0x7f1382d749d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:23.425041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a13241c-b5bf-4f03-95d3-0dfa5d74a2b9 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180524639" status: 202 len: 0 microversion: 2.1 time: 0.081202 Apr 05 11:39:23.425621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 445/858] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Apr 5 11:39:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180524639 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:39:26.714592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:26.715081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:26.721867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:26.722322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:26.723089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:26.723550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:26.748248 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:39:27.076449 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-327118dc-e1ba-4df8-a295-dc7200ed098a tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 204 len: 0 microversion: 2.1 time: 0.364344 Apr 05 11:39:27.077039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 414/859] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:39:26 2022] DELETE /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:39:27.085038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:27.085782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:27.094179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:27.094625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:27.095471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:27.095906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:27.227796 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:27.235700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d07e9cf6-b7d7-4268-a05e-79f52417564d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1508 microversion: 2.1 time: 0.154566 Apr 05 11:39:27.236266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 446/860] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:27 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:28.254053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:28.254884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:28.261304 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:28.261757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:28.262527 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:28.263027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:28.395582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:28.402830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-95e20d4e-94c2-499b-9dc2-d042cc301d42 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1508 microversion: 2.1 time: 0.153036 Apr 05 11:39:28.403390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 415/861] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:28 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:29.420549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:29.421170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:29.427665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:29.428120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:29.428891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:29.429328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:29.564413 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:29.571763 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd395ad8-a4f3-41bb-ad24-a513bf7c0927 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1508 microversion: 2.1 time: 0.155739 Apr 05 11:39:29.572338 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 447/862] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:29 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:30.589800 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:30.590496 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:30.609837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:30.610286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:30.611147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:30.611615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:30.639915 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-0eb8d2b0-2133-4123-a331-1fd3473cbb51 req-c1f0007b-00da-4db8-a3e0-cf56c4890e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2fd886b-f0e3-4596-bdec-cdfa852af6a3", "name": "network-vif-deleted", "tag": "2fb694b4-1fdd-4b95-9ce5-859afbba5e16"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:30.651453 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-0eb8d2b0-2133-4123-a331-1fd3473cbb51 req-c1f0007b-00da-4db8-a3e0-cf56c4890e73 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:30.651891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-0eb8d2b0-2133-4123-a331-1fd3473cbb51 req-c1f0007b-00da-4db8-a3e0-cf56c4890e73 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:30.664601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-0eb8d2b0-2133-4123-a331-1fd3473cbb51 req-c1f0007b-00da-4db8-a3e0-cf56c4890e73 service nova] Creating event network-vif-deleted:2fb694b4-1fdd-4b95-9ce5-859afbba5e16 for instance e2fd886b-f0e3-4596-bdec-cdfa852af6a3 on hv-cinder-83444 Apr 05 11:39:30.669590 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-0eb8d2b0-2133-4123-a331-1fd3473cbb51 req-c1f0007b-00da-4db8-a3e0-cf56c4890e73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Apr 05 11:39:30.670290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 448/863] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:30.681332 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:30.689184 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f8fbbe18-130c-45e7-b23a-19345f7384bd tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1466 microversion: 2.1 time: 0.103518 Apr 05 11:39:30.689758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 416/864] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:30 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1466 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:31.707732 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:31.708436 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:31.714656 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:31.715113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:31.716580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:31.717025 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:31.747444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:31.747922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:31.748369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'fault' on Instance uuid e2fd886b-f0e3-4596-bdec-cdfa852af6a3 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:31.790150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:31.799062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67eb13fa-a9a6-4827-9194-08a1c3850404 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 200 len: 1312 microversion: 2.1 time: 0.095984 Apr 05 11:39:31.799749 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 449/865] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:31 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:32.817292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:32.817900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: e2fd886b-f0e3-4596-bdec-cdfa852af6a3] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:32.823980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:32.824455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:32.825373 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:32.825821 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:32.838583 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] HTTP exception thrown: Instance e2fd886b-f0e3-4596-bdec-cdfa852af6a3 could not be found. Apr 05 11:39:32.839171 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Returning 404 to user: Instance e2fd886b-f0e3-4596-bdec-cdfa852af6a3 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:32.840029 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2e8337e1-9560-4212-9171-601e4683e18d tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3" status: 404 len: 111 microversion: 2.1 time: 0.026628 Apr 05 11:39:32.840560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 417/866] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:32 2022] GET /compute/v2.1/servers/e2fd886b-f0e3-4596-bdec-cdfa852af6a3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:39:32.848829 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:32.849332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:32.855694 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:32.856152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:32.857552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:32.857982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:32.883966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:39:33.201226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66a434e5-c72a-4fd5-b5d1-90ec179ecac6 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 204 len: 0 microversion: 2.1 time: 0.355818 Apr 05 11:39:33.201837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 450/867] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:39:32 2022] DELETE /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:39:33.210109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:33.210741 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:33.217873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:33.221486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:33.221486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:33.221486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:33.355774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:33.363977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-76485c55-8ead-44a7-9029-4cf2a5bf5583 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.157661 Apr 05 11:39:33.364552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 418/868] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:33 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:34.381802 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:34.382607 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:34.389456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:34.389912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:34.390689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:34.391132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:34.521954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:34.530369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7372f69e-30c2-41ea-a8d8-01aef89603f8 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.152892 Apr 05 11:39:34.531013 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 451/869] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:34 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:35.547409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:35.548049 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:35.554403 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:35.554852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:35.555657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:35.556096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:35.698760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:35.706277 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b3e40617-9d4f-4dbe-b0c5-6eb7aff04d64 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.162811 Apr 05 11:39:35.706854 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 419/870] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:35 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:36.722791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:36.723550 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:36.729565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:36.730027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:36.730809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:36.732200 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:36.871053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:36.878714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ed49c5b-6655-43a0-91c4-e87ae8207a26 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1523 microversion: 2.1 time: 0.159825 Apr 05 11:39:36.879309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 452/871] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:36 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:37.492016 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-0e047ae2-81e5-4bea-be12-50a05e4c0097 req-44bb27dd-f179-41a4-a889-ccfc1cbe131b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f8790e-86d5-4392-8b87-74f29cb57aa1", "name": "network-vif-deleted", "tag": "9f189aab-4ee0-4998-b00f-266952c9e388"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:37.500815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0e047ae2-81e5-4bea-be12-50a05e4c0097 req-44bb27dd-f179-41a4-a889-ccfc1cbe131b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:37.501340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0e047ae2-81e5-4bea-be12-50a05e4c0097 req-44bb27dd-f179-41a4-a889-ccfc1cbe131b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:37.512968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-0e047ae2-81e5-4bea-be12-50a05e4c0097 req-44bb27dd-f179-41a4-a889-ccfc1cbe131b service nova] Creating event network-vif-deleted:9f189aab-4ee0-4998-b00f-266952c9e388 for instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 on hv-cinder-83444 Apr 05 11:39:37.517975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-0e047ae2-81e5-4bea-be12-50a05e4c0097 req-44bb27dd-f179-41a4-a889-ccfc1cbe131b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029600 Apr 05 11:39:37.518571 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 420/872] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:37.896488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:37.897278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:37.904176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:37.904691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:37.905502 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:37.905946 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:37.937675 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:37.938132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:37.938587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lazy-loading 'fault' on Instance uuid 22f8790e-86d5-4392-8b87-74f29cb57aa1 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:37.978620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185ec21337a4154b650b30b89519716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1490a12f854ca78e6f0f6f25418eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:37.986583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6196b768-34f7-4ded-b838-a2a5e7b37776 tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 200 len: 1312 microversion: 2.1 time: 0.094101 Apr 05 11:39:37.987167 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 453/873] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:37 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:38.581262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-650315932"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:38.581807 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:38.587923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:38.588370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:38.589126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:38.589561 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:38.728740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.network.security_group_api [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Removing security group 6407e0af-4d09-4667-97e7-cd7a4e13bfee from port 1c450bf1-70cb-43f6-b3c7-8ca81f6a779b Apr 05 11:39:39.004085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:39.004705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] [instance: 22f8790e-86d5-4392-8b87-74f29cb57aa1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:39.011041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:39.011557 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:39.012343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:39.012783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:39.027003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] HTTP exception thrown: Instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 could not be found. Apr 05 11:39:39.027613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] Returning 404 to user: Instance 22f8790e-86d5-4392-8b87-74f29cb57aa1 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:39.028487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d76bfdf-5b47-410b-b641-c7466fc4902e tempest-ServerRescueNegativeTestJSON-2033827868 tempest-ServerRescueNegativeTestJSON-2033827868-project] 10.222.0.60 "GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1" status: 404 len: 111 microversion: 2.1 time: 0.029133 Apr 05 11:39:39.029042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 454/874] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:38 2022] GET /compute/v2.1/servers/22f8790e-86d5-4392-8b87-74f29cb57aa1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:39:39.154489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5def7e98-5549-4cd3-bae8-20beb3401166 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action" status: 202 len: 0 microversion: 2.1 time: 0.578488 Apr 05 11:39:39.155108 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 421/875] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Apr 5 11:39:38 2022] POST /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:39:39.536692 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d173f3df-5633-4ff3-9020-d47ba2c6a881 req-e807f920-5d7a-449b-b927-943d2e321034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:39.550117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d173f3df-5633-4ff3-9020-d47ba2c6a881 req-e807f920-5d7a-449b-b927-943d2e321034 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:39.550532 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d173f3df-5633-4ff3-9020-d47ba2c6a881 req-e807f920-5d7a-449b-b927-943d2e321034 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:39.578176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d173f3df-5633-4ff3-9020-d47ba2c6a881 req-e807f920-5d7a-449b-b927-943d2e321034 service nova] Creating event network-changed:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:39:39.588417 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d173f3df-5633-4ff3-9020-d47ba2c6a881 req-e807f920-5d7a-449b-b927-943d2e321034 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055650 Apr 05 11:39:39.589029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 455/876] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:39:41.220650 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:41.221211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:41.228543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:41.228990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:41.229756 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:41.230195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:41.335344 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lazy-loading 'services' on Instance uuid cbe35228-f44c-438d-8be8-0b14f59b2826 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:41.637727 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7b438416-f318-4632-a014-440bc6f107d4 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments/996bf98a-a653-4e15-8e78-4f2c8485b060" status: 202 len: 0 microversion: 2.1 time: 0.419180 Apr 05 11:39:41.639066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 422/877] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:39:41 2022] DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments/996bf98a-a653-4e15-8e78-4f2c8485b060 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:39:41.645588 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-ae268148-e426-491b-8fe6-e55e2a5d2bd3 req-f5ea12db-1ec7-44c2-a5e9-c2d333e09a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:41.653088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:41.654650 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:41.662587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:41.663448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:41.664502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:41.665215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:41.672278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ae268148-e426-491b-8fe6-e55e2a5d2bd3 req-f5ea12db-1ec7-44c2-a5e9-c2d333e09a72 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:41.673680 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ae268148-e426-491b-8fe6-e55e2a5d2bd3 req-f5ea12db-1ec7-44c2-a5e9-c2d333e09a72 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:41.690944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-ae268148-e426-491b-8fe6-e55e2a5d2bd3 req-f5ea12db-1ec7-44c2-a5e9-c2d333e09a72 service nova] Creating event network-changed:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:39:41.697704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-ae268148-e426-491b-8fe6-e55e2a5d2bd3 req-f5ea12db-1ec7-44c2-a5e9-c2d333e09a72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064833 Apr 05 11:39:41.698708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 456/878] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:41.715228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2a29c398-1a7f-4805-896b-fb0500e29135 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066066 Apr 05 11:39:41.720499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 423/879] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:41 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:42.730241 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:42.731399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:42.738242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:42.744753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:42.744753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:42.744753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:42.769727 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9fe3fba6-f430-4c4f-9247-3aaac6bd4b18 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Apr 05 11:39:42.770304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 457/880] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:42 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:39:42.871320 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:42.871948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:42.878623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:42.879252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:42.880069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:42.880509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:42.904013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e84e5c36-c76c-4984-83db-20a19594bb51 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/ips" status: 200 len: 151 microversion: 2.20 time: 0.105544 Apr 05 11:39:42.904573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 424/881] 10.222.0.60 () {60 vars in 1288 bytes} [Tue Apr 5 11:39:42 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/ips => generated 151 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:39:43.780656 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:43.781699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:43.788328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:43.788783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:43.789561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:43.790000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:43.819395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-70690db8-e436-40ee-a712-3e07ce2e31fd tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042755 Apr 05 11:39:43.819989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 458/882] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:39:43 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:39:43.830896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:43.831395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:43.837692 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:43.838177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:43.838981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:43.839535 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:43.918886 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] HTTP exception thrown: Instance cbe35228-f44c-438d-8be8-0b14f59b2826 is not attached to volume 996bf98a-a653-4e15-8e78-4f2c8485b060 Apr 05 11:39:43.920209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Returning 404 to user: Instance cbe35228-f44c-438d-8be8-0b14f59b2826 is not attached to volume 996bf98a-a653-4e15-8e78-4f2c8485b060 {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:43.922026 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-59bf525f-2e5b-4571-89c4-db7b2c6c8e83 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments/996bf98a-a653-4e15-8e78-4f2c8485b060" status: 404 len: 154 microversion: 2.1 time: 0.096233 Apr 05 11:39:43.922964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 425/883] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:39:43 2022] DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826/os-volume_attachments/996bf98a-a653-4e15-8e78-4f2c8485b060 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:39:45.309884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:45.310430 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:45.316891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.317342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.318114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.318552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.360140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:39:45.600659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96adc905-f986-4dde-b030-20dbe72c74fb tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 204 len: 0 microversion: 2.1 time: 0.294478 Apr 05 11:39:45.601706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 459/884] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:39:45 2022] DELETE /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:39:45.611385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:45.612131 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:45.618696 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.619211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.620153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.620587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.750974 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80510f78-41b1-44d8-ac6c-46af8f70e15a tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Action: 'create', calling method: .version_select at 0x7f1382abc430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-175540628", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:45.760738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:45.769199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-873fef89-d776-47e7-86ed-d7aa0fa5ae20 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1556 microversion: 2.1 time: 0.162954 Apr 05 11:39:45.769763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 426/885] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:45 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:39:45.815937 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:45.816408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:45.822306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.822762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.823563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:45.824008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:45.846939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lazy-loading 'flavor' on Instance uuid 4d88e619-6518-47fd-a6aa-5e4e90281f8c {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:46.425644 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80510f78-41b1-44d8-ac6c-46af8f70e15a tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.793408 Apr 05 11:39:46.426270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 460/886] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Apr 5 11:39:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 795 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 05 11:39:46.428726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3c7b2978-5577-4c0c-8cb7-ff352279c9a2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/action" status: 202 len: 0 microversion: 2.20 time: 0.617510 Apr 05 11:39:46.430639 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 427/887] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Apr 5 11:39:45 2022] POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:39:46.438562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd76fb76-c60d-458f-8bf4-c1a02de0bf48 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f1382d18dc0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:46.440323 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:46.441027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:46.447674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:46.448147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:46.448927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:46.449412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:46.496138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd76fb76-c60d-458f-8bf4-c1a02de0bf48 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 200 len: 352 microversion: 2.1 time: 0.062608 Apr 05 11:39:46.496858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 461/888] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:39:46 2022] GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:46.587228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:46.595521 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:46.597009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:46.598158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ba71c7d2-ca1f-4add-8683-c9584bc797bc tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.162512 Apr 05 11:39:46.598719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 428/889] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:46 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:46.786856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:46.790069 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:46.794495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:46.794949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:46.795759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:46.796525 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:46.933487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:46.941804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-259c7629-33c4-4682-9a9c-3521ba716d54 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1556 microversion: 2.1 time: 0.158737 Apr 05 11:39:46.942313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 462/890] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:46 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:47.509163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b7574014-f689-47e9-b243-ddec28df5bf5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f13823b48b0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.555801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b7574014-f689-47e9-b243-ddec28df5bf5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 200 len: 353 microversion: 2.1 time: 0.050438 Apr 05 11:39:47.556623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 429/891] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:39:47 2022] GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:47.567526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-641fed74-fb7c-4138-ab2a-648a65bb923f tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f1382d74040>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.613613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-641fed74-fb7c-4138-ab2a-648a65bb923f tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 200 len: 353 microversion: 2.1 time: 0.049801 Apr 05 11:39:47.614214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 463/892] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:39:47 2022] GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:47.616893 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.617498 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:47.623629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:47.624082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:47.625005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:47.625708 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:47.630017 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8cf78fb-b54a-455b-a410-80bcb3c9dc7d tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f1382abcca0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.763088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:47.771785 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:47.779587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:47.779587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-769a9a76-276f-4187-a3cc-613f95db1846 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.161466 Apr 05 11:39:47.779587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 430/893] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:47 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:39:47.840148 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8cf78fb-b54a-455b-a410-80bcb3c9dc7d tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 202 len: 0 microversion: 2.1 time: 0.213751 Apr 05 11:39:47.840871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 464/894] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:39:47 2022] DELETE /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:39:47.849346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-db854b6a-6b6a-442a-b346-0216719bdca5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f1382346b80>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.896509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-db854b6a-6b6a-442a-b346-0216719bdca5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 200 len: 352 microversion: 2.1 time: 0.050870 Apr 05 11:39:47.897074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 431/895] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:39:47 2022] GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:47.958879 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:47.959653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:47.966659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:47.967110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:47.967970 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:47.968589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:48.105959 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:48.113512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a96afd45-9d0d-4f99-bb3b-c41af39e693f tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1556 microversion: 2.1 time: 0.158698 Apr 05 11:39:48.114090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 465/896] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:47 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:48.567038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-e539115b-ce08-4f1e-8b2e-43600976ec07 req-e0223eb1-b5f8-43ab-a6ff-e1394c62dc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe35228-f44c-438d-8be8-0b14f59b2826", "name": "network-vif-deleted", "tag": "1c450bf1-70cb-43f6-b3c7-8ca81f6a779b"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:48.575825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e539115b-ce08-4f1e-8b2e-43600976ec07 req-e0223eb1-b5f8-43ab-a6ff-e1394c62dc29 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:48.576270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e539115b-ce08-4f1e-8b2e-43600976ec07 req-e0223eb1-b5f8-43ab-a6ff-e1394c62dc29 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:48.586841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-e539115b-ce08-4f1e-8b2e-43600976ec07 req-e0223eb1-b5f8-43ab-a6ff-e1394c62dc29 service nova] Creating event network-vif-deleted:1c450bf1-70cb-43f6-b3c7-8ca81f6a779b for instance cbe35228-f44c-438d-8be8-0b14f59b2826 on hv-cinder-83444 Apr 05 11:39:48.591600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-e539115b-ce08-4f1e-8b2e-43600976ec07 req-e0223eb1-b5f8-43ab-a6ff-e1394c62dc29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028889 Apr 05 11:39:48.592211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 432/897] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:48.794161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:48.794764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:48.803443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:48.803897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:48.804665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:48.805104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:48.910968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-49f477b0-0d55-4a9e-bd4f-f71b624eabd5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Calling method '.version_select at 0x7f13823469d0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:48.941799 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-49f477b0-0d55-4a9e-bd4f-f71b624eabd5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] HTTP exception thrown: Volume 45319494-53f5-4bf1-97cd-d05230452271 could not be found. Apr 05 11:39:48.942396 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-49f477b0-0d55-4a9e-bd4f-f71b624eabd5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] Returning 404 to user: Volume 45319494-53f5-4bf1-97cd-d05230452271 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:48.943465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-49f477b0-0d55-4a9e-bd4f-f71b624eabd5 tempest-VolumesGetTestJSON-1809474772 tempest-VolumesGetTestJSON-1809474772-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271" status: 404 len: 109 microversion: 2.1 time: 0.038213 Apr 05 11:39:48.950984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 433/898] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:39:48 2022] GET /compute/v2.1/os-volumes/45319494-53f5-4bf1-97cd-d05230452271 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:39:48.957065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:48.965058 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:48.966613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:48.967825 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-376d39d7-640c-40ab-94cd-286d40398983 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.177653 Apr 05 11:39:48.969859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 466/899] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:48 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:49.130321 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:49.130920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:49.137557 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:49.138004 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:49.138760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:49.139189 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:49.169539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:49.170003 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:49.170426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lazy-loading 'fault' on Instance uuid cbe35228-f44c-438d-8be8-0b14f59b2826 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:39:49.211574 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8f31b171e394b2fbf9d9e3e3fd6b9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5f73d3bb5948299a1d81283e0c738a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:49.219940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-50dee3a9-3cc2-4874-96cf-b7112de74879 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 200 len: 1349 microversion: 2.1 time: 0.092956 Apr 05 11:39:49.220520 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 434/900] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:49 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:39:49.992884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:49.993494 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:50.000974 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:50.001426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:50.002190 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:50.002623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:50.139034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:50.147060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:50.148626 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:50.149798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-acc777a3-7398-49c5-b97d-5bdfc93cb19a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.160830 Apr 05 11:39:50.150361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 467/901] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:49 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:50.237228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:50.237840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] [instance: cbe35228-f44c-438d-8be8-0b14f59b2826] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:50.243998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:50.244450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:50.245211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:50.245644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:50.258895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] HTTP exception thrown: Instance cbe35228-f44c-438d-8be8-0b14f59b2826 could not be found. Apr 05 11:39:50.259514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Returning 404 to user: Instance cbe35228-f44c-438d-8be8-0b14f59b2826 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:39:50.260340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b5da6024-d981-4879-a225-c13a97f2ab39 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826" status: 404 len: 111 microversion: 2.1 time: 0.027510 Apr 05 11:39:50.260879 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 435/902] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:39:50 2022] GET /compute/v2.1/servers/cbe35228-f44c-438d-8be8-0b14f59b2826 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:39:50.268906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c6d4214d-3d1a-46d0-a030-2384d66c7917 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] Calling method '.version_select at 0x7f1382e38ca0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:50.339707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c6d4214d-3d1a-46d0-a030-2384d66c7917 tempest-TestMinimumBasicScenario-588309024 tempest-TestMinimumBasicScenario-588309024-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245855514" status: 202 len: 0 microversion: 2.1 time: 0.074455 Apr 05 11:39:50.340304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 468/903] 10.222.0.60 () {58 vars in 1271 bytes} [Tue Apr 5 11:39:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245855514 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:39:51.168385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:51.168993 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:51.175802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:51.176254 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:51.177022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:51.177456 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:51.314728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:51.322910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:51.324642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:51.325898 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3432aa64-fd57-4d87-8a05-4927538aae1c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.161355 Apr 05 11:39:51.336799 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 436/904] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:51 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:52.164499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:52.165179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:52.172003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:52.172463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:52.173264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:52.173707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:52.198113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1eeaba26-59bd-464a-beed-3b400f0ed882 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/ips" status: 200 len: 150 microversion: 2.1 time: 0.212845 Apr 05 11:39:52.198960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 469/905] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:39:51 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/ips => generated 150 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:52.345772 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:52.346372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:52.352658 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:52.353107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:52.353952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:52.354387 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:52.600044 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:52.607826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:52.610244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:52.611400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-52e2afb7-4acd-432b-9347-40d084064706 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.271132 Apr 05 11:39:52.611984 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 437/906] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:52 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:53.632466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:53.633120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:53.640065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:53.640586 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:53.641568 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:53.642009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:53.785362 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:53.797878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:53.797878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:53.798226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-179a2a11-58cd-40fd-b361-1cda736f671d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.169749 Apr 05 11:39:53.799091 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 470/907] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:53 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:54.817540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:54.818126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:54.825132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:54.825581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:54.826350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:54.827313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:55.028753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:55.039173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:55.040901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:55.042080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2d7b12ee-b61a-4764-8d55-45fd71f2a833 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.228524 Apr 05 11:39:55.042626 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 438/908] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:54 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:55.187856 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c212bc32-595b-4f2e-8de5-593e35cbb0a3"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:55.189703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:55.198723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:55.199330 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:55.200231 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:55.200855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:56.028288 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2458fef-2622-4ce3-9416-1d45de687dd1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844724 Apr 05 11:39:56.035266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 471/909] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:39:55 2022] POST /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:56.067701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:56.067701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:56.074267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:56.074735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:56.075640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:56.075995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:56.309728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:56.320185 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:56.321925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:56.324845 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-40668ef1-32ff-4562-9b9a-037b4fd79684 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.267471 Apr 05 11:39:56.326077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 439/910] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:56 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:56.682777 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:56.683545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:56.689892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:56.690390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:56.691166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:56.691636 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:56.717848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f44f0c9c-96cc-4da7-94e9-c04bfa8a0ddb tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/ips" status: 200 len: 145 microversion: 2.1 time: 0.039882 Apr 05 11:39:56.719282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 472/911] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:39:56 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:57.342845 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:57.343472 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:57.349979 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:57.350433 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:57.351222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:57.351682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:57.497729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:57.508700 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:57.510798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:57.512195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c4379ac2-dc05-4af1-816b-d51d2559c654 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.173923 Apr 05 11:39:57.523394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 440/912] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:57 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:58.542253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:58.542253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:58.542253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:58.542253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:58.543562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:58.543562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:58.543730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74c3730a-50f6-4a05-ad12-a0bcf12f2be1"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:39:58.544313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:58.551165 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:58.551928 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:58.552923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:58.553640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:58.742651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:58.753574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:58.756566 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:58.769051 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0168f7ad-1038-4eca-ad37-3d80183ce172 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.232551 Apr 05 11:39:58.770000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 473/913] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:58 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:39:59.323206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-188cdc70-9860-4be0-a78e-e83951c26231 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784544 Apr 05 11:39:59.323781 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 441/914] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:39:58 2022] POST /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:39:59.779300 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:39:59.779955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:39:59.786375 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:59.787106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:59.787920 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:39:59.788524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:39:59.974455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:59.984213 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:59.985801 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:39:59.986977 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b974e116-181f-469a-8346-f5a75346d85a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.211952 Apr 05 11:39:59.987565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 474/915] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:39:59 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:01.005938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:01.006647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:01.013023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:01.013482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:01.014307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:01.015375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:01.171289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:01.178468 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:01.180057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:01.181515 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-10e7f16f-4807-4d8f-92f0-28ac60619319 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.180405 Apr 05 11:40:01.182064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 442/916] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:00 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:02.200633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:02.201250 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:02.207652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:02.208147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:02.208930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:02.209372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:02.379551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:02.379551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:02.379982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:02.379982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-faa54e10-c78d-459c-816a-73452563f519 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.169055 Apr 05 11:40:02.379982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 475/917] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:02 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:03.387582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:03.389552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:03.397864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.399523 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:03.400613 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.401334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:03.581297 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:03.595064 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:03.596720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:03.598290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-47bbea76-fba5-46fa-8a1a-9c28e7d34972 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.216245 Apr 05 11:40:03.598916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 443/918] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:03 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:03.758407 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c212bc32-595b-4f2e-8de5-593e35cbb0a3"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:03.759546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:03.768908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.769614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:03.773921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.773921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:03.886311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Invalid volume: volume c212bc32-595b-4f2e-8de5-593e35cbb0a3 is already attached to instances: 3945b25c-4ebb-40d4-aa74-715634c40e57 Apr 05 11:40:03.886934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 400 to user: Invalid volume: volume c212bc32-595b-4f2e-8de5-593e35cbb0a3 is already attached to instances: 3945b25c-4ebb-40d4-aa74-715634c40e57 {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:03.887864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7f3dc894-316b-46af-bf2a-a6f16567de2e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134007 Apr 05 11:40:03.888444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 476/919] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:40:03 2022] POST /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:40:03.968902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:03.973211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:03.976619 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.977073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:03.977849 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:03.978286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:04.074900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'services' on Instance uuid 3945b25c-4ebb-40d4-aa74-715634c40e57 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:40:04.288916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fdd79e51-7a05-46b0-975a-816db596f92d tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments/c212bc32-595b-4f2e-8de5-593e35cbb0a3" status: 202 len: 0 microversion: 2.1 time: 0.324619 Apr 05 11:40:04.289514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 444/920] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:40:03 2022] DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments/c212bc32-595b-4f2e-8de5-593e35cbb0a3 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:40:04.298800 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:04.299808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:04.306197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:04.306897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:04.315254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:04.315254 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:04.344787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-12155d9d-f42e-4ab4-a72a-f9973401cb6f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050638 Apr 05 11:40:04.345374 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 477/921] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:04 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:04.620173 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:04.620866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:04.628465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:04.635581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:04.635581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:04.635581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:04.783862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:04.791610 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:04.793126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:04.794292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a0c20fe9-3a67-409e-96c9-db8fefb2b9a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.178785 Apr 05 11:40:04.800934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 445/922] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:04 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:05.356599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:05.357565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:05.365027 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:05.365474 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:05.366232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:05.366664 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:05.396033 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4d0d3e5-f86d-4e34-a00c-04fdb8db5ab3 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Apr 05 11:40:05.396587 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 478/923] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:05 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:40:05.813599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:05.814479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:05.823509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:05.824186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:05.824962 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:05.825398 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:05.972502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:05.976327 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:05.977816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:05.978968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a87afd0c-7efb-472f-b8bb-09b6cdc30fb4 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.169273 Apr 05 11:40:05.979561 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 446/924] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:05 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:06.407691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:06.408949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:06.415191 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:06.415711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:06.416490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:06.416931 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:06.446843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2106b8c-e8eb-4cdb-bab7-7d46e6166401 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Apr 05 11:40:06.447429 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 479/925] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:06 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:06.997217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:06.997825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:07.004251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:07.004698 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:07.005462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:07.005898 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:07.304309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:07.314009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:07.315582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:07.316969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2c165ccf-1348-428a-b17f-d7f22c611273 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.323699 Apr 05 11:40:07.317533 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 447/926] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:06 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:07.458816 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:07.459787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:07.466006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:07.467860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:07.467860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:07.467860 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:07.495721 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-59c8b4a4-6899-4eac-97ef-7d6b0d6f71dc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Apr 05 11:40:07.496268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 480/927] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:07 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:08.335982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:08.336560 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:08.343961 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:08.344405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:08.345206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:08.345724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:08.489608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:08.498089 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:08.499891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:08.502920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a2e13ea8-859f-49b0-9bf6-575b31446482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1742 microversion: 2.20 time: 0.169334 Apr 05 11:40:08.507859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:08.508806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:08.514657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 448/928] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:08 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:08.515549 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:08.516038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:08.516853 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:08.517299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:08.546989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d8b988a-e8e0-4fd4-9462-3ae6359d404a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Apr 05 11:40:08.547584 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 481/929] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:08 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:40:09.521389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:09.522028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:09.528330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:09.528782 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:09.529549 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:09.530132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:09.558733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:09.559863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:09.567630 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:09.568218 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:09.569030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:09.569456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:09.599880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a1a65ed-7596-480d-999d-13b7ad4fa34a tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Apr 05 11:40:09.600463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 482/930] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:09 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:40:09.661177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:09.668986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:09.671022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:09.672210 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bcd40b10-3277-446d-87ac-0d290987993c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1742 microversion: 2.20 time: 0.154701 Apr 05 11:40:09.672764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 449/931] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:09 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:10.610464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:10.611409 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:10.619460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:10.619460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:10.619460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:10.619864 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:10.653248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b2cda3a2-0cdc-4a7c-921e-cd3113eb3036 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Apr 05 11:40:10.653821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 483/932] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:10 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:10.691675 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:10.692286 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:10.698586 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:10.699022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:10.699831 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:10.700264 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:10.843594 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:10.852444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:10.854270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:10.855828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e32c388a-091b-451b-8316-d482e84be526 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1742 microversion: 2.20 time: 0.167952 Apr 05 11:40:10.867903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 450/933] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:10 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:11.136818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-93124d09-fca7-4aa7-a465-52b251c445e4 req-a46bcf82-308c-486e-b92a-d19dd5dfa77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "name": "network-vif-plugged", "status": "completed", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:11.151103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-93124d09-fca7-4aa7-a465-52b251c445e4 req-a46bcf82-308c-486e-b92a-d19dd5dfa77e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:11.151103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-93124d09-fca7-4aa7-a465-52b251c445e4 req-a46bcf82-308c-486e-b92a-d19dd5dfa77e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:11.159507 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-93124d09-fca7-4aa7-a465-52b251c445e4 req-a46bcf82-308c-486e-b92a-d19dd5dfa77e service nova] Creating event network-vif-plugged:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:40:11.164671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-93124d09-fca7-4aa7-a465-52b251c445e4 req-a46bcf82-308c-486e-b92a-d19dd5dfa77e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152860 Apr 05 11:40:11.165353 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 484/934] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:11.665348 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:11.665818 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:11.672945 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:11.673401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:11.674187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:11.674624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:11.705009 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-90dfe1ce-3fc2-41c2-92b3-13e13a8c75b7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Apr 05 11:40:11.708801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 451/935] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:11 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:11.875840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:11.876472 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:11.882580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:11.883035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:11.883838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:11.884280 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.043117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:12.055815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:12.057335 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:12.074463 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0dee0480-34bb-4213-8c8e-0132838f2482 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.203960 Apr 05 11:40:12.075061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 485/936] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:11 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:12.241826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:12.243652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:12.250926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.263497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.263497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.263497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.300550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9dea9ab9-2669-45fa-944d-ce0818935038 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065416 Apr 05 11:40:12.301346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 452/937] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:12 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:12.316207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:12.317445 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:12.326163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.327099 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.328519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.329097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.370192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39c58f49-2f17-4233-8aac-9307dbb0b92f tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1" status: 200 len: 194 microversion: 2.1 time: 0.061974 Apr 05 11:40:12.370798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 486/938] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Apr 5 11:40:12 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:12.719810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:12.722139 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:12.729260 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.729889 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.730974 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.731425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.769931 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5de0a973-14a4-4435-a650-8c6967612928 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057166 Apr 05 11:40:12.770547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 453/939] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:12 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:40:12.976222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:12.976770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:12.982833 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.983321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:12.984222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:12.984671 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:13.015018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:40:13.092809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:13.094297 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:13.107160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:13.115211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:13.117303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:13.117303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:13.297043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:13.307166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:13.313310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:13.314713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-deefc81c-ef2d-4e56-aa59-8c1647bc5795 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.225889 Apr 05 11:40:13.315689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 454/940] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:13 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:13.464508 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7956fcf4-f20b-40ab-b700-d6d1150858c1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 204 len: 0 microversion: 2.1 time: 0.492557 Apr 05 11:40:13.468073 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 487/941] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:40:12 2022] DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:40:13.478104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:13.479795 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:13.487502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:13.487954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:13.488766 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:13.489204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:13.654318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:13.663926 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a4cf6c59-3cad-45ec-b136-7ed2897fd392 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1681 microversion: 2.1 time: 0.189791 Apr 05 11:40:13.675097 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 455/942] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:13 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:14.200580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff99f09f-3559-4f95-b7f5-40843c1886a8"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:14.201999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:14.216487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.217717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.218783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.219327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.333440 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:14.334051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:14.340954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.341416 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.343061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.343550 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.500585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:14.511341 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:14.512896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:14.514830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-021add1c-3418-461e-a24e-fbbbab8ea295 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.184994 Apr 05 11:40:14.515852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 456/943] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:14 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:14.683259 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:14.683903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:14.696085 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.696750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.697563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:14.697998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:14.875769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:14.883391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5c58e48d-06c9-4c1a-a2b6-5b89cc47a3b6 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1681 microversion: 2.1 time: 0.204587 Apr 05 11:40:14.887666 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 457/944] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:14 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:15.534971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:15.536386 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:15.542676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:15.543316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:15.544268 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:15.545048 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:15.777448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:15.786501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:15.788412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:15.789852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-691e6ae7-97a0-41d9-a380-41f227507c45 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.258862 Apr 05 11:40:15.791046 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 458/945] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:15 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:15.904724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:15.905404 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:15.914301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:15.917544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:15.918549 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:15.919444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:15.984295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4dd8b495-bbac-4f7a-9224-0190c7602b3a tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "POST /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.787962 Apr 05 11:40:15.988438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 488/946] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:40:14 2022] POST /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 194 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:16.338942 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:16.348596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a22577fa-c3d3-41f7-98e4-1c9d27833cf7 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1681 microversion: 2.1 time: 0.451520 Apr 05 11:40:16.353793 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 459/947] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:15 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1681 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:16.573275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-2e8f816f-9635-42b2-9ffb-e3ce6faf471c req-255c1007-1717-4b36-a3c3-f7c7b93fb18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3945b25c-4ebb-40d4-aa74-715634c40e57", "name": "network-vif-deleted", "tag": "91e6a764-953d-4b1e-9902-5211db07b9b6"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:16.590969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-2e8f816f-9635-42b2-9ffb-e3ce6faf471c req-255c1007-1717-4b36-a3c3-f7c7b93fb18e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:16.591435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-2e8f816f-9635-42b2-9ffb-e3ce6faf471c req-255c1007-1717-4b36-a3c3-f7c7b93fb18e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:16.624619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-2e8f816f-9635-42b2-9ffb-e3ce6faf471c req-255c1007-1717-4b36-a3c3-f7c7b93fb18e service nova] Creating event network-vif-deleted:91e6a764-953d-4b1e-9902-5211db07b9b6 for instance 3945b25c-4ebb-40d4-aa74-715634c40e57 on hv-cinder-83444 Apr 05 11:40:16.639858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-2e8f816f-9635-42b2-9ffb-e3ce6faf471c req-255c1007-1717-4b36-a3c3-f7c7b93fb18e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069875 Apr 05 11:40:16.640669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 489/948] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:16.811653 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:16.812461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:16.818747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:16.834169 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:16.843295 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:16.843971 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:17.041311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:17.060735 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:17.062027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:17.064501 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2c58818d-8126-4c99-802e-8a08774c462d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.260027 Apr 05 11:40:17.092825 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 460/949] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:16 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:17.416900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:17.416900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:17.416900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:17.416900 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:17.417602 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:17.417602 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:17.436624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:17.437034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:17.437500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'fault' on Instance uuid 3945b25c-4ebb-40d4-aa74-715634c40e57 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:40:17.513425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:17.527458 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b11011e-9e00-4481-a55c-4c48ff0dd967 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 200 len: 1330 microversion: 2.1 time: 0.162534 Apr 05 11:40:17.528658 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 490/950] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:17 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 1330 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:18.095479 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:18.097198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:18.110840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:18.111734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:18.112758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:18.113407 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:18.307313 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:18.320809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:18.326652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:18.328224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ae14352f-4a5f-4576-a41b-add60abf6097 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.238529 Apr 05 11:40:18.329430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 461/951] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:18 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:18.548391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:18.548999 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:18.563398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:18.563960 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:18.564833 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:18.565365 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:18.582998 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. Apr 05 11:40:18.589455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:18.589455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d1391d8-2cfe-4951-ac69-0e31977a95ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 404 len: 111 microversion: 2.1 time: 0.041344 Apr 05 11:40:18.589455 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 491/952] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:18 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:18.597321 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b5973f6e-dd0f-45ce-9b31-b4ef9b60d9df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '.version_select at 0x7f1382487790>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:18.726904 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b5973f6e-dd0f-45ce-9b31-b4ef9b60d9df tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138677751" status: 202 len: 0 microversion: 2.1 time: 0.133489 Apr 05 11:40:18.728030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 462/953] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Apr 5 11:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138677751 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:40:19.348565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:19.353551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:19.355394 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:19.356278 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:19.356673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:19.359585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:19.630023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:19.644720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:19.646732 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:19.648106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c588f3f-4bb3-43ac-b380-a8f1387386b2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.303696 Apr 05 11:40:19.660465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 492/954] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:19 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:20.019105 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: .version_select at 0x7f13826eea60>, body: {"keypair": {"name": "tempest-keypair-959893800"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:20.039244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:40:20.045862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:40:20.239953 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:40:20.244480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:40:20.260917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-590abf0a-6dd6-443b-9a7e-1fffb091ab95 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.246182 Apr 05 11:40:20.262121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 463/955] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:40:20 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:20.667388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:20.668645 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:20.681870 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:20.682323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:20.686913 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:20.687377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:20.876950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:20.890916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:20.892602 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:20.898650 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fe409ddb-657d-43b2-b7a3-a19c29fdb9e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.235156 Apr 05 11:40:20.899371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 493/956] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:20 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:21.918328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:21.919104 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:21.931012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:21.931553 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:21.932388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:21.934602 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:22.154579 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:22.169054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:22.187679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:22.187679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3bc8e047-b678-4394-b70d-7bb91542415b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.259686 Apr 05 11:40:22.187679 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 464/957] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:21 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:23.193040 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:23.195275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:23.207891 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:23.208619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:23.209585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:23.210194 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:23.404573 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:23.417026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:23.421095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:23.422862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-179cb826-a6ce-4ecd-a7a7-5bbb9a0dfdd9 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.233623 Apr 05 11:40:23.428571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 494/958] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:23 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:23.556124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820871414", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83da91da-2a37-43a9-b807-df1a6d29d057"}], "security_groups": [{"name": "tempest-securitygroup--754577770"}], "key_name": "tempest-keypair-959893800", "user_data": "}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:23.676663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.network.neutron [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] validate_networks() for [('83da91da-2a37-43a9-b807-df1a6d29d057', None, None, None, None, None)] {{(pid=124243) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:40:24.236267 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:40:24.236910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:40:24.237390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Flavor pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:40:24.237798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Image pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:40:24.238209 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:40:24.248482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.248930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.249740 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.250400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.267147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:40:24.271204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Getting quotas for user 3c75b53446424f4cad4b12129234d740 and project d629246f6ced4cc8b75399b7a0723868. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:40:24.283401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Going to run 1 instances... {{(pid=124243) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:40:24.285728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:40:24.450795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:24.450795 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:24.455051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b3ddb078-2409-491d-bcf2-9866a5b44a10 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.903766 Apr 05 11:40:24.455745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 465/959] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:40:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:40:24.461940 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.462695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.463182 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.463646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.470002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-97f8c008-cf43-45e3-b36c-dddd6c5db2e8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:24.470611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-97f8c008-cf43-45e3-b36c-dddd6c5db2e8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:24.542703 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-97f8c008-cf43-45e3-b36c-dddd6c5db2e8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:24.549975 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-97f8c008-cf43-45e3-b36c-dddd6c5db2e8 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1240 microversion: 2.1 time: 0.084843 Apr 05 11:40:24.550546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 466/960] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:24 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:24.657153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:24.675584 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:24.677435 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:24.678848 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67df18ba-3e16-411d-bd76-69051a51be9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1737 microversion: 2.20 time: 0.238187 Apr 05 11:40:24.679495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 495/961] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:24 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:24.734215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:24.735278 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:24.741981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.742836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.743204 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.743691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.775189 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3488603a-e803-485e-b607-96d2c4ba98e1 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045144 Apr 05 11:40:24.775786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 467/962] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:24 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:24.930121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:24.930693 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:24.937575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.938097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.938945 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:24.946157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:24.993048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6959bfdf-db3c-4c79-a1d6-cdd2d3dd6e4e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1" status: 200 len: 194 microversion: 2.1 time: 0.067140 Apr 05 11:40:25.008632 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 496/963] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Apr 5 11:40:24 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:25.008817 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:25.008817 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:25.010429 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.010881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.011680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.012120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.094728 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lazy-loading 'services' on Instance uuid 52b5b208-b301-4cff-a73e-af0e1a97afc6 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:40:25.291920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e70cc87a-a1f2-4f29-9c49-ba5f9bff0d22 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1" status: 202 len: 0 microversion: 2.1 time: 0.291362 Apr 05 11:40:25.292573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 468/964] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:40:24 2022] DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/74c3730a-50f6-4a05-ad12-a0bcf12f2be1 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:40:25.566685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:25.567299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:25.573709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.574158 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.574919 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.575358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.635537 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:25.643270 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-339b4d50-7e79-4c90-b2b5-3d613305de68 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1244 microversion: 2.1 time: 0.080410 Apr 05 11:40:25.647313 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 497/965] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:25 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:25.698335 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:25.699036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:25.706046 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.706504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.707289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:25.707756 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:25.932186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:25.944096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:25.947511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:25.950001 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-192df1c3-1ae0-4e7d-b797-4e11218e280d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1719 microversion: 2.20 time: 0.255931 Apr 05 11:40:25.959486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 469/966] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:25 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:26.673955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:26.674570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:26.687217 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:26.688763 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:26.689699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:26.690001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:26.764060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:26.772728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d256145-5ed9-4a5a-a492-e5db05cea69f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1292 microversion: 2.1 time: 0.109413 Apr 05 11:40:26.783181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 498/967] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:26 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1292 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:26.970419 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:26.971153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:26.977754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:26.978219 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:26.979060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:26.979596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:27.115563 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:27.129895 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:27.131949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:27.133333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2440c702-c16b-4587-8967-98e3bf787d0f tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1719 microversion: 2.20 time: 0.167854 Apr 05 11:40:27.134068 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 470/968] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:26 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:27.800757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:27.806441 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:27.812711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:27.813156 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:27.819006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:27.819493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:27.907068 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:27.917576 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d1260e8-4bc0-472e-b5e6-d1755da6b6ea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1292 microversion: 2.1 time: 0.130337 Apr 05 11:40:27.919127 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 499/969] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:27 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:28.157981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:28.159109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:28.168458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.168458 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.169375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.170376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.424537 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:28.432999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:28.434662 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:28.436734 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3d5b02a1-e341-43bb-aa3b-8a00dc059f02 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1722 microversion: 2.20 time: 0.287378 Apr 05 11:40:28.437535 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 471/970] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:28 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:28.457047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3893e35-3053-4252-acc4-235d0b2731e0"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:28.458157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:28.464010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.464515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.465238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.465665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.562395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:28.563328 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:28.571186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.572007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.573405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.574079 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.636350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3a9b146f-b84a-4273-a366-91f4a51a9f13 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/ff99f09f-3559-4f95-b7f5-40843c1886a8" status: 200 len: 194 microversion: 2.1 time: 0.080279 Apr 05 11:40:28.637222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 472/971] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Apr 5 11:40:28 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/ff99f09f-3559-4f95-b7f5-40843c1886a8 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:28.648292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:28.650083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:28.661246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.668028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.669099 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:28.689058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:28.820120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lazy-loading 'services' on Instance uuid 52b5b208-b301-4cff-a73e-af0e1a97afc6 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:40:29.102378 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fb6b5e44-1f0a-4ea3-827b-7f7c1e86ccf0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/ff99f09f-3559-4f95-b7f5-40843c1886a8" status: 202 len: 0 microversion: 2.1 time: 0.457994 Apr 05 11:40:29.125843 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 473/972] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:40:28 2022] DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments/ff99f09f-3559-4f95-b7f5-40843c1886a8 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:40:29.135647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:29.137211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:29.157933 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:29.158847 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:29.165022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:29.167909 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:29.330897 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:29.344999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4f624ede-2a25-4013-a7d0-a0fb605b3d7c tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1298 microversion: 2.1 time: 0.215016 Apr 05 11:40:29.352149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 474/973] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:29 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:29.355308 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-bc5bf2a2-1021-4918-832a-9525285cb4ab req-842d8a1d-dde7-4726-870b-0e521dc8f069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "name": "network-vif-unplugged", "status": "completed", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:29.368454 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-bc5bf2a2-1021-4918-832a-9525285cb4ab req-842d8a1d-dde7-4726-870b-0e521dc8f069 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:29.369394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-bc5bf2a2-1021-4918-832a-9525285cb4ab req-842d8a1d-dde7-4726-870b-0e521dc8f069 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:29.385911 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.compute.server_external_events [req-bc5bf2a2-1021-4918-832a-9525285cb4ab req-842d8a1d-dde7-4726-870b-0e521dc8f069 service nova] Unable to find a host for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c. Dropping event network-vif-unplugged {{(pid=124243) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 05 11:40:29.389798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-bc5bf2a2-1021-4918-832a-9525285cb4ab req-842d8a1d-dde7-4726-870b-0e521dc8f069 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041106 Apr 05 11:40:29.390585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 475/974] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 05 11:40:29.867169 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5ab77f3-23d1-4a74-bf42-be701a1fe0af tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.414021 Apr 05 11:40:29.884215 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 500/975] 10.222.0.60 () {62 vars in 1363 bytes} [Tue Apr 5 11:40:28 2022] POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments => generated 188 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:40:30.064253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:30.065226 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:30.075035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.075439 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.076906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.079080 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.365260 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:30.365895 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:30.374490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.374975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.375834 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.376275 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.716100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:30.728696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e41e7b2-7152-4d6d-80c1-730cfb48ea29 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.368324 Apr 05 11:40:30.729875 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 501/976] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:30 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:30.735138 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:30.736169 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:30.755120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.755606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.756402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:30.756834 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:30.798069 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de9c5cf6-8ca1-4813-a853-1b3474c7f43e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066815 Apr 05 11:40:30.799024 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 502/977] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:30 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:40:30.917806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-de93571c-79d2-4cac-b0d1-9d59837c069d tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments/a3893e35-3053-4252-acc4-235d0b2731e0" status: 202 len: 0 microversion: 2.20 time: 0.858466 Apr 05 11:40:30.918829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 476/978] 10.222.0.60 () {60 vars in 1456 bytes} [Tue Apr 5 11:40:30 2022] DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments/a3893e35-3053-4252-acc4-235d0b2731e0 => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:40:30.999638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:31.000221 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.006185 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:31.007307 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.025620 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.026075 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.026873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.027309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.029588 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.030144 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.030934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.031364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.129682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d9f21271-7564-4f6f-8d46-0f6c5902ab8d tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127723 Apr 05 11:40:31.130715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 477/979] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:40:31 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:40:31.139391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-d4e9d630-fc7f-4efd-a5c3-1aa7e8fe55d6 req-48fce66a-5a85-49bb-ac9c-a1d4c71a8bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312dd592-597c-40c9-88fb-502a44b126c1", "tag": "c972cbda-2f1a-4d11-8109-75d7b53e0483"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:31.160811 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d4e9d630-fc7f-4efd-a5c3-1aa7e8fe55d6 req-48fce66a-5a85-49bb-ac9c-a1d4c71a8bde service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.161262 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d4e9d630-fc7f-4efd-a5c3-1aa7e8fe55d6 req-48fce66a-5a85-49bb-ac9c-a1d4c71a8bde service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.178611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-d4e9d630-fc7f-4efd-a5c3-1aa7e8fe55d6 req-48fce66a-5a85-49bb-ac9c-a1d4c71a8bde service nova] Creating event network-changed:c972cbda-2f1a-4d11-8109-75d7b53e0483 for instance 312dd592-597c-40c9-88fb-502a44b126c1 on hv-cinder-83444 Apr 05 11:40:31.184187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-d4e9d630-fc7f-4efd-a5c3-1aa7e8fe55d6 req-48fce66a-5a85-49bb-ac9c-a1d4c71a8bde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052152 Apr 05 11:40:31.193689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 478/980] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:31.223755 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:31.224631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.231266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.232509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.233668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.234271 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.262095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:40:31.487753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a29e3b50-d6b0-459d-ab38-8c04ea760cb5 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/action" status: 202 len: 0 microversion: 2.20 time: 0.495032 Apr 05 11:40:31.495377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 503/981] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Apr 5 11:40:30 2022] POST /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:40:31.504382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:31.505186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.514990 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.516812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.517621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.518072 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.673215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c4495826-6127-4539-822b-f438a00605b0 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 204 len: 0 microversion: 2.1 time: 0.454090 Apr 05 11:40:31.677584 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:31.678174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 479/982] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:40:31 2022] DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:40:31.686823 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:31.692257 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.694980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:31.696561 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:31.697747 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4f8668b5-9353-4d47-ac14-c1548b9ae088 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1670 microversion: 2.20 time: 0.198719 Apr 05 11:40:31.698400 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 504/983] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:31 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:31.707689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.707689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.707689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.707689 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.746371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:31.748064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:31.754954 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.755446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.756319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:31.756757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:31.869450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:31.878357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9fc0764e-40ff-4200-96ce-53cacfb5e543 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1672 microversion: 2.1 time: 0.197463 Apr 05 11:40:31.879200 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 480/984] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:31 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:31.952336 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:31.961459 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-018cc29c-c64d-4388-8468-3c5490d22399 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.219333 Apr 05 11:40:31.962168 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 505/985] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:31 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:32.719161 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:32.720019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:32.726659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:32.727206 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:32.728078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:32.728573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:32.895982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:32.897478 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:32.904124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:32.904699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:32.905585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:32.906256 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:32.962789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:32.979214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:32.981081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:32.984587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ba11dca7-e6ef-451e-840a-c64e0b8df47a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1670 microversion: 2.20 time: 0.270488 Apr 05 11:40:32.996129 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 481/986] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:32 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1670 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:33.006600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:33.008280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:33.017370 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:33.017817 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:33.018750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:33.019936 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:33.068565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:33.076614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-315ee5c4-d335-4a5f-abdb-d815b5cc807e tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1672 microversion: 2.1 time: 0.184469 Apr 05 11:40:33.077401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 506/987] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:32 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:33.632544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:33.646995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-679d1f2a-f51e-48e3-92f2-5d9a78b14181 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.649630 Apr 05 11:40:33.657005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 482/988] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:32 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:34.009139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:34.010600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:34.020563 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.022357 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.023599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.026791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.095632 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:34.096842 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:34.109529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.110890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.112072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.112754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.337804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:34.353618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:34.358044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:34.360354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8937e3b5-9b76-4b6a-8556-51c4889f9093 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.358220 Apr 05 11:40:34.364356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 507/989] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:33 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:34.442007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:34.443366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f786351a-ca3e-41c2-931f-f379fc02dabf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1672 microversion: 2.1 time: 0.353467 Apr 05 11:40:34.444050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 483/990] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:34 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1672 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:34.665063 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:34.665652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:34.675724 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.677425 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.678236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:34.678728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:34.999723 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:35.016695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-35debe7f-0ff6-4d49-8693-0aba02bf2bdc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.355498 Apr 05 11:40:35.018405 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 508/991] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:34 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:35.258815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-1c4ff547-41ad-4b10-914e-2bb2acdae2e4 req-37fe0572-33ca-4c3f-967b-4b8402d9b820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b5b208-b301-4cff-a73e-af0e1a97afc6", "name": "network-vif-deleted", "tag": "5c5e83d8-b424-46aa-b736-6580c02b211f"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:35.274402 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1c4ff547-41ad-4b10-914e-2bb2acdae2e4 req-37fe0572-33ca-4c3f-967b-4b8402d9b820 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:35.274856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1c4ff547-41ad-4b10-914e-2bb2acdae2e4 req-37fe0572-33ca-4c3f-967b-4b8402d9b820 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:35.288276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-1c4ff547-41ad-4b10-914e-2bb2acdae2e4 req-37fe0572-33ca-4c3f-967b-4b8402d9b820 service nova] Creating event network-vif-deleted:5c5e83d8-b424-46aa-b736-6580c02b211f for instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 on hv-cinder-83444 Apr 05 11:40:35.297611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-1c4ff547-41ad-4b10-914e-2bb2acdae2e4 req-37fe0572-33ca-4c3f-967b-4b8402d9b820 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040761 Apr 05 11:40:35.297611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 484/992] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:35.380533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:35.381212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:35.402490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:35.404956 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:35.405920 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:35.407665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:35.461656 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:35.462413 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:35.474652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:35.480208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:35.481055 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:35.481500 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:35.626768 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cabbaa06864741528fb3ae510ec8c01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346b36188734d548c57bb9d7d63476d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:35.637738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-fe9e9495-d024-4122-8335-eb685c792a55 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 200 len: 1321 microversion: 2.1 time: 0.179513 Apr 05 11:40:35.640767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 485/993] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:35 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:36.001714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:36.018346 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:36.020235 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:36.021432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9866edef-59e0-416c-b400-2f6794203504 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.646252 Apr 05 11:40:36.022551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 509/994] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:35 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:36.038988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:36.039822 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:36.046188 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:36.046643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:36.047441 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:36.048489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:36.354545 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:36.365448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-65b8ca49-533f-4b17-b45d-1f71d7941896 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.330651 Apr 05 11:40:36.371507 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 486/995] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:36 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:36.655693 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:36.656492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:36.667327 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:36.667966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:36.668868 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:36.671447 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:36.704676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. Apr 05 11:40:36.705874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:36.706952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c994df90-c6e1-480c-baf2-dbcb7ff6ee06 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 404 len: 111 microversion: 2.1 time: 0.055562 Apr 05 11:40:36.707962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 510/996] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:36 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:36.717517 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f7393042-f333-4b6d-a1e4-1debc9ac5814 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '.version_select at 0x7f13824d7280>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:36.795054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f7393042-f333-4b6d-a1e4-1debc9ac5814 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999646338" status: 202 len: 0 microversion: 2.1 time: 0.082472 Apr 05 11:40:36.800608 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 487/997] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Apr 5 11:40:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999646338 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:40:37.041038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:37.042464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:37.049409 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:37.050223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:37.051053 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:37.051523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:37.312312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:37.320865 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:37.322704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:37.324140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb2ba11e-b374-42e3-8d0d-bc1aa9bb2d96 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.287704 Apr 05 11:40:37.336009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 511/998] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:37 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:37.384826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:37.387019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:37.417168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:37.417890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:37.419349 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:37.420866 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:38.298695 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:38.309519 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c132850b-16a5-4a20-acee-2b2407453e35 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.931143 Apr 05 11:40:38.320871 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 488/999] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:37 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:38.343469 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:38.347803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:38.361170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:38.361638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:38.362600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:38.363135 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:38.654036 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:38.665484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:38.667637 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:38.669189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-65c0e74d-fb15-433f-bb68-1c26bec814a7 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.330545 Apr 05 11:40:38.680121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 512/1000] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:38 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:39.329164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:39.331130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:39.345573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:39.347163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:39.348070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:39.348577 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:39.637150 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:39.645934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-af2f3fa8-decb-4658-9e08-0da2d945b47b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.321300 Apr 05 11:40:39.647281 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 489/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:39 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:39.698724 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:39.700485 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:39.719285 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:39.720576 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:39.722022 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:39.726465 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:39.750361 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-9b343d75-37be-403e-bbef-20cd6b266e87 req-cc1e963c-533f-420f-bcd4-f858b36eaecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312dd592-597c-40c9-88fb-502a44b126c1", "name": "network-vif-plugged", "status": "completed", "tag": "c972cbda-2f1a-4d11-8109-75d7b53e0483"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:39.769350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9b343d75-37be-403e-bbef-20cd6b266e87 req-cc1e963c-533f-420f-bcd4-f858b36eaecd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:39.773232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9b343d75-37be-403e-bbef-20cd6b266e87 req-cc1e963c-533f-420f-bcd4-f858b36eaecd service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:39.819852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-9b343d75-37be-403e-bbef-20cd6b266e87 req-cc1e963c-533f-420f-bcd4-f858b36eaecd service nova] Creating event network-vif-plugged:c972cbda-2f1a-4d11-8109-75d7b53e0483 for instance 312dd592-597c-40c9-88fb-502a44b126c1 on hv-cinder-83444 Apr 05 11:40:39.830530 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-9b343d75-37be-403e-bbef-20cd6b266e87 req-cc1e963c-533f-420f-bcd4-f858b36eaecd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083391 Apr 05 11:40:39.831359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 490/1002] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:40:40.222090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:40.245082 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:40.252456 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:40.257163 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ce532528-e51f-4505-804f-62dde10731e2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.570204 Apr 05 11:40:40.263214 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 513/1003] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:39 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:40.666567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:40.667941 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:40.681060 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:40.681509 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:40.682291 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:40.687274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.082255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:41.101514 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7bc4ed5d-8831-453c-bc3a-9ed8a2fa1953 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.439744 Apr 05 11:40:41.103933 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 491/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:40 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:41.288888 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:41.290267 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:41.331195 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.333777 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.338610 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.342388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.462912 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:41.463450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:41.493773 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.497544 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.500339 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.500821 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.530920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. Apr 05 11:40:41.531549 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:41.532391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6d0f588a-e420-43e6-bdc6-0b0891f0d6ce tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 404 len: 111 microversion: 2.1 time: 0.078754 Apr 05 11:40:41.536345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 492/1005] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:40:41 2022] DELETE /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:40:41.582884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:41.592559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:41.594122 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:41.595601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7e546771-af39-4d72-8f5e-2f9529f9d4a0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.318893 Apr 05 11:40:41.596863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 514/1006] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:41 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:41.613083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:41.614155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 52b5b208-b301-4cff-a73e-af0e1a97afc6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:41.620426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.621115 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.622089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:41.623290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:41.641239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. Apr 05 11:40:41.641839 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 52b5b208-b301-4cff-a73e-af0e1a97afc6 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:41.642672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1333878a-1626-4e25-9bb7-71a95d404e58 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6" status: 404 len: 111 microversion: 2.1 time: 0.044896 Apr 05 11:40:41.643239 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 515/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:41 2022] GET /compute/v2.1/servers/52b5b208-b301-4cff-a73e-af0e1a97afc6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:41.735540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Action: 'create', calling method: .version_select at 0x7f138237e160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2098956905"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:41.750798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for project 0bfd09739367451297d7d3042eb37411. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:40:41.755510 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for user 3b1109ba42564e7fb2e1e831fdc09280 and project 0bfd09739367451297d7d3042eb37411. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:40:42.121763 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:42.123199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:42.131491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:42.132643 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:42.134066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:42.148669 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:42.186628 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for project 0bfd09739367451297d7d3042eb37411. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:40:42.193464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for user 3b1109ba42564e7fb2e1e831fdc09280 and project 0bfd09739367451297d7d3042eb37411. Resources: {'key_pairs'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:40:42.211239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-31c4696d-b2b5-41fd-b767-e4329be0e787 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.673595 Apr 05 11:40:42.212004 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 493/1008] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Apr 5 11:40:41 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:42.379091 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:42.388512 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b2cc20b-353d-470c-9e4c-488d6da288bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.270215 Apr 05 11:40:42.389146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 516/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:42 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:42.616674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:42.617633 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:42.624687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:42.625564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:42.626992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:42.627683 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:42.805428 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:42.814690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:42.816682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:42.819017 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1e184cfe-39b3-4b85-af39-7e7288026f39 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.206141 Apr 05 11:40:42.820290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 494/1010] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:42 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:43.023866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:43.024554 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:43.031711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.032396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.033428 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.033866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.049248 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. Apr 05 11:40:43.049871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:43.057176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-53516951-e796-4c3d-b436-f89b989ce6bf tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 404 len: 111 microversion: 2.1 time: 0.031549 Apr 05 11:40:43.057176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 517/1011] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:40:43 2022] DELETE /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:43.062924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:43.063600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] [instance: 271ec1c3-3848-4d8c-99be-ecc15be7f06f] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:43.071857 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.072338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.073142 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.073586 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.092164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] HTTP exception thrown: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. Apr 05 11:40:43.092830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] Returning 404 to user: Instance 271ec1c3-3848-4d8c-99be-ecc15be7f06f could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:43.093678 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7eb5be84-c13a-455c-a608-c4d057333d21 tempest-AttachVolumeTestJSON-689731971 tempest-AttachVolumeTestJSON-689731971-project] 10.222.0.60 "GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f" status: 404 len: 111 microversion: 2.1 time: 0.035237 Apr 05 11:40:43.094551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 495/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:43 2022] GET /compute/v2.1/servers/271ec1c3-3848-4d8c-99be-ecc15be7f06f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:43.409347 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:43.410113 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:43.435516 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.435972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.436774 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.437937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.846750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:43.848056 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:43.876420 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.876420 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.881758 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:43.882536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:43.966410 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:43.986229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a3753bb-d708-4904-b7d8-289c485809af tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 0.583173 Apr 05 11:40:43.989312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 518/1013] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:43 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:40:44.394465 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:44.412218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:44.414102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:44.415649 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-bcb30c1b-9dda-444f-bbf2-957f4d4e66ed tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.580879 Apr 05 11:40:44.416829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 496/1014] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:43 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:45.010249 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:45.011983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:45.025783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:45.029366 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:45.032416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:45.039134 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:45.376809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:45.377862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:45.403833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:45.403833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:45.403833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:45.403833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:45.480124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:40:46.167017 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:46.194580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-544d548c-ba1c-486f-9d6d-742bc41234ad tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1365 microversion: 2.1 time: 1.184085 Apr 05 11:40:46.196454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 519/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:45 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1365 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:46.201872 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d5c1fb25-0c9f-4d23-9249-11315d9fe8e7 req-4e1b8ee9-6d54-49c8-a39e-276d05734ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:46.239627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d5c1fb25-0c9f-4d23-9249-11315d9fe8e7 req-4e1b8ee9-6d54-49c8-a39e-276d05734ea8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:46.240317 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d5c1fb25-0c9f-4d23-9249-11315d9fe8e7 req-4e1b8ee9-6d54-49c8-a39e-276d05734ea8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:46.250954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e6cdf100-be2a-404a-8d7b-093235afa32a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 204 len: 0 microversion: 2.1 time: 0.878421 Apr 05 11:40:46.254806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 497/1016] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:40:45 2022] DELETE /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:40:46.269030 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:46.270002 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:46.303187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d5c1fb25-0c9f-4d23-9249-11315d9fe8e7 req-4e1b8ee9-6d54-49c8-a39e-276d05734ea8 service nova] Creating event network-changed:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:40:46.303384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:46.303384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:46.303384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:46.303384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:46.318329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d5c1fb25-0c9f-4d23-9249-11315d9fe8e7 req-4e1b8ee9-6d54-49c8-a39e-276d05734ea8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120343 Apr 05 11:40:46.320130 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 520/1017] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:46.326332 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:46.331956 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:46.354095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:46.359012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:46.359012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:46.359012 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:46.860054 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:46.881561 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:46.890989 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:46.892578 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c843bcbf-bdbb-4bc0-827f-2fd1244842e0 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.636567 Apr 05 11:40:46.893147 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 498/1018] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:46 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:47.193702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:47.202320 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d71d30b-dd47-46b6-819c-1edf8fe0933e tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.880536 Apr 05 11:40:47.211957 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:47.212835 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:47.218473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 521/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:46 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:47.222603 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.223021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:47.224043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.224500 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:47.455053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:47.463119 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c4c727ca-94e7-4903-9728-8c03bb1930bc tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1554 microversion: 2.1 time: 0.255596 Apr 05 11:40:47.464643 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 499/1020] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:47 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:47.480703 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:47.481236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:47.487388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.487868 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:47.488700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.489148 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:47.684164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dbe0d506-8acf-43ee-b9f7-ad97fcc33599 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207494 Apr 05 11:40:47.685600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 522/1021] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Apr 5 11:40:47 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:47.916349 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:47.917624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:47.931374 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.939946 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:47.940872 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:47.941546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:48.224843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:48.226061 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:48.239265 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:48.249174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:48.249174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:48.249174 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:48.346032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:48.354224 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:48.358363 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:48.359609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3a9f9a6a-2999-4a85-8aee-8705d68e82df tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.449355 Apr 05 11:40:48.374929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 500/1022] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:47 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:48.643942 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:48.661221 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dedfbd90-4e42-4832-9ae5-3e2c03e1ce58 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.441374 Apr 05 11:40:48.662066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 523/1023] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:48 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:49.380737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:49.381369 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:49.389292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:49.389920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:49.391053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:49.391741 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:49.681566 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:49.682950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:49.690892 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:49.693819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:49.693819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:49.693819 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:49.863490 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:49.879330 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:49.880797 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:49.882039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e9c3e34f-c659-4753-9821-b039013f97c8 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.505919 Apr 05 11:40:49.882547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 501/1024] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:49 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:50.073413 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-b7b71df8-df64-4379-b4fe-5d7cbb1cec30 req-a4cc9cd3-b14a-408e-9f84-07b0e1e7ddbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312dd592-597c-40c9-88fb-502a44b126c1", "tag": "c972cbda-2f1a-4d11-8109-75d7b53e0483"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:50.088632 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-b7b71df8-df64-4379-b4fe-5d7cbb1cec30 req-a4cc9cd3-b14a-408e-9f84-07b0e1e7ddbb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:50.089098 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-b7b71df8-df64-4379-b4fe-5d7cbb1cec30 req-a4cc9cd3-b14a-408e-9f84-07b0e1e7ddbb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:50.105796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-b7b71df8-df64-4379-b4fe-5d7cbb1cec30 req-a4cc9cd3-b14a-408e-9f84-07b0e1e7ddbb service nova] Creating event network-changed:c972cbda-2f1a-4d11-8109-75d7b53e0483 for instance 312dd592-597c-40c9-88fb-502a44b126c1 on hv-cinder-83444 Apr 05 11:40:50.126634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-b7b71df8-df64-4379-b4fe-5d7cbb1cec30 req-a4cc9cd3-b14a-408e-9f84-07b0e1e7ddbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057449 Apr 05 11:40:50.127815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 502/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:40:50.175827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:50.190719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-393dbabd-0b68-4f5b-b8e6-4f293c57c944 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1570 microversion: 2.1 time: 0.513634 Apr 05 11:40:50.191651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 524/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:49 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1570 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:50.522118 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-5997a851-7bfe-4f4a-9a5f-e0a4571478c4 req-41b99c26-2711-4ab5-ab03-93d8f3c70d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723380a-3b3f-4f00-b701-f76ab30add84", "name": "network-vif-deleted", "tag": "1057f1d4-8f36-4dbf-a01f-5a583883cb27"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:50.530950 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-5997a851-7bfe-4f4a-9a5f-e0a4571478c4 req-41b99c26-2711-4ab5-ab03-93d8f3c70d30 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:50.531402 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-5997a851-7bfe-4f4a-9a5f-e0a4571478c4 req-41b99c26-2711-4ab5-ab03-93d8f3c70d30 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:50.546681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-5997a851-7bfe-4f4a-9a5f-e0a4571478c4 req-41b99c26-2711-4ab5-ab03-93d8f3c70d30 service nova] Creating event network-vif-deleted:1057f1d4-8f36-4dbf-a01f-5a583883cb27 for instance d723380a-3b3f-4f00-b701-f76ab30add84 on hv-cinder-83444 Apr 05 11:40:50.552488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-5997a851-7bfe-4f4a-9a5f-e0a4571478c4 req-41b99c26-2711-4ab5-ab03-93d8f3c70d30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Apr 05 11:40:50.556380 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 503/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:50.903354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:50.904197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:50.919124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:50.919609 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:50.923991 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:50.924844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:51.212391 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:51.213900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:51.238716 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:51.263502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:51.264239 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:51.265055 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:51.268150 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:51.269606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:51.272760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:51.279934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57cb6239-e00d-438a-b35a-fce049a1a70c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.376533 Apr 05 11:40:51.282350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 525/1028] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:50 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:51.431177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:51.438332 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-dfe120fe-708c-46de-856c-3aa91ab6f45a tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1220 microversion: 2.1 time: 0.231900 Apr 05 11:40:51.441721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 504/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:51 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:52.300608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:52.301861 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:52.310599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:52.310939 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:52.312000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:52.312617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:52.459489 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:52.460289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:52.475726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:52.475726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:52.475726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:52.475726 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:52.478082 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:52.492695 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:52.494319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:52.495707 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-714f7835-4d05-4acf-9426-929d322651be tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.199075 Apr 05 11:40:52.496283 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 526/1030] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:52 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:52.505096 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:52.505542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:52.506160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lazy-loading 'fault' on Instance uuid d723380a-3b3f-4f00-b701-f76ab30add84 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:40:52.553144 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae94e637c714c90a660f824b42c8fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8499ce2abe10411589e913912a8c40ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:52.561488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-f4e7bd50-ce06-4e59-91c5-58e7beea6da6 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 200 len: 1388 microversion: 2.1 time: 0.107210 Apr 05 11:40:52.562071 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 505/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:52 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 1388 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:40:53.522132 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:53.523408 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:53.533644 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:53.534310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:53.535288 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:53.535809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:53.580949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:53.580949 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] [instance: d723380a-3b3f-4f00-b701-f76ab30add84] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:53.586471 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:53.587019 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:53.587916 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:53.588417 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:53.603939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] HTTP exception thrown: Instance d723380a-3b3f-4f00-b701-f76ab30add84 could not be found. Apr 05 11:40:53.604670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Returning 404 to user: Instance d723380a-3b3f-4f00-b701-f76ab30add84 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:40:53.605901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4f026338-77b5-4b18-a540-fc772f4c02cd tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84" status: 404 len: 111 microversion: 2.1 time: 0.031247 Apr 05 11:40:53.607729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 506/1032] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:40:53 2022] GET /compute/v2.1/servers/d723380a-3b3f-4f00-b701-f76ab30add84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:40:53.612915 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-4f3f8948-fed8-4d85-b9bc-f5495f4ecb72 req-01c31d86-19a0-4c65-9504-367a7af19d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "name": "network-vif-plugged", "status": "completed", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:40:53.621157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-4f3f8948-fed8-4d85-b9bc-f5495f4ecb72 req-01c31d86-19a0-4c65-9504-367a7af19d65 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:53.621867 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-4f3f8948-fed8-4d85-b9bc-f5495f4ecb72 req-01c31d86-19a0-4c65-9504-367a7af19d65 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:53.634258 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-4f3f8948-fed8-4d85-b9bc-f5495f4ecb72 req-01c31d86-19a0-4c65-9504-367a7af19d65 service nova] Creating event network-vif-plugged:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:40:53.640222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-4f3f8948-fed8-4d85-b9bc-f5495f4ecb72 req-01c31d86-19a0-4c65-9504-367a7af19d65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Apr 05 11:40:53.640999 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 507/1033] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:40:53.739490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:53.748513 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:53.754491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:53.756420 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c1d25ac-813c-49ac-8f3c-8d3c75cc8b90 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.240100 Apr 05 11:40:53.769950 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 527/1034] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:53 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:40:53.923930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6cfb0828-22fb-45f5-a9a2-6e5245b3ea97 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] Calling method '.version_select at 0x7f13824e5700>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:54.099920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6cfb0828-22fb-45f5-a9a2-6e5245b3ea97 tempest-TestShelveInstance-1228155738 tempest-TestShelveInstance-1228155738-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2035940498" status: 202 len: 0 microversion: 2.1 time: 0.180676 Apr 05 11:40:54.100859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 508/1035] 10.222.0.60 () {58 vars in 1253 bytes} [Tue Apr 5 11:40:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2035940498 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:40:54.778901 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:54.779574 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:54.785596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:54.786041 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:54.786863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:54.787256 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:54.999269 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:55.011849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:55.011849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:55.011849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ecbcc9f4-38ea-4ca0-844c-2c4b09123b7a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.235538 Apr 05 11:40:55.012176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 528/1036] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:54 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:56.029638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:56.031065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:56.037567 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:56.038392 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:56.039289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:56.039851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:56.233390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:56.241952 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:56.243455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:56.244634 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-64501568-5b91-413f-bf10-fb3dfb941e82 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.219727 Apr 05 11:40:56.245192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 509/1037] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:56 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:57.264106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:57.264854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:57.271029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:57.271511 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:57.272338 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:57.272773 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:57.441522 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:57.444548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:57.446169 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:57.447498 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c17baf4c-eb51-493b-98dc-1fd12522a985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1728 microversion: 2.20 time: 0.187895 Apr 05 11:40:57.448161 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 529/1038] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:57 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:40:58.466745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:40:58.467357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:40:58.473813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:58.474266 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:58.475037 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:40:58.475508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:40:58.625653 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:58.633473 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:58.637035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:40:58.637035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b8bf93b4-869d-46a4-a06c-f52a011b4e1b tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1715 microversion: 2.20 time: 0.174036 Apr 05 11:40:58.637035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 510/1039] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:40:58 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:07.302198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2122577160", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098956905", "security_groups": [{"name": "tempest-secgroup-smoke-1021731976"}], "block_device_mapping_v2": [{"uuid": "22836e2a-9bec-40f1-81b3-c463efe55f44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6351c4b7-133d-4471-82de-f39f3c9f175f"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:07.423355 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] validate_networks() for [('6351c4b7-133d-4471-82de-f39f3c9f175f', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:41:07.781780 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:41:07.782203 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:41:07.782838 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:41:07.783242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:41:07.783677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:41:07.792393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:07.794106 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:07.794922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:07.795360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:07.812726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:41:07.816589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for user 3b1109ba42564e7fb2e1e831fdc09280 and project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:41:07.872177 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:41:07.874290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22836e2a-9bec-40f1-81b3-c463efe55f44',volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:41:08.310464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-61603e56-19b9-4aeb-8177-60488da7159d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.012052 Apr 05 11:41:08.311393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 530/1040] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:41:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:41:08.321084 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7b5e44bb-b87d-446d-bcd4-877437cd06ef tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:08.321670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7b5e44bb-b87d-446d-bcd4-877437cd06ef tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:08.374451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7b5e44bb-b87d-446d-bcd4-877437cd06ef tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:08.381143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7b5e44bb-b87d-446d-bcd4-877437cd06ef tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1095 microversion: 2.1 time: 0.063951 Apr 05 11:41:08.381722 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 511/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:08 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:09.398810 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-515949d2-f901-4085-a2ce-8d7c555521a1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:09.399367 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-515949d2-f901-4085-a2ce-8d7c555521a1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:09.451807 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-515949d2-f901-4085-a2ce-8d7c555521a1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:09.458398 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-515949d2-f901-4085-a2ce-8d7c555521a1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1095 microversion: 2.1 time: 0.064149 Apr 05 11:41:09.458968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 531/1042] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:09 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:10.475801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:10.476293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:10.484218 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:10.485488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:10.485488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:10.485906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:10.545270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:10.552664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2f608357-6fcc-4cf3-a297-65775d6ad3dd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1193 microversion: 2.1 time: 0.081141 Apr 05 11:41:10.558678 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 512/1043] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:10 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:11.573885 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:11.575124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:11.582299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:11.582912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:11.583728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:11.584170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:11.644831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:11.653859 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-78450f0b-445c-4345-958d-d6df3d676385 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1211 microversion: 2.1 time: 0.082699 Apr 05 11:41:11.654449 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 532/1044] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:11 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:12.679178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:12.679836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:12.688513 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:12.688965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:12.689755 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:12.690205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:13.020186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:13.028268 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6e8eab27-e178-4d66-bf67-3795151480dc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.354495 Apr 05 11:41:13.028873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 513/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:12 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:13.187153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-436ade2d-03b6-44c7-b2d9-37f8cf662a21 req-99d32670-b2f6-4488-9193-e5f491b95b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d592d6-a3fa-42be-8e0d-81b3932cf139", "tag": "4129f153-1ece-4259-82d8-7a290c87852d"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:13.204804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-436ade2d-03b6-44c7-b2d9-37f8cf662a21 req-99d32670-b2f6-4488-9193-e5f491b95b01 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:13.204804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-436ade2d-03b6-44c7-b2d9-37f8cf662a21 req-99d32670-b2f6-4488-9193-e5f491b95b01 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:13.216943 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-436ade2d-03b6-44c7-b2d9-37f8cf662a21 req-99d32670-b2f6-4488-9193-e5f491b95b01 service nova] Creating event network-changed:4129f153-1ece-4259-82d8-7a290c87852d for instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 on hv-cinder-83444 Apr 05 11:41:13.222102 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-436ade2d-03b6-44c7-b2d9-37f8cf662a21 req-99d32670-b2f6-4488-9193-e5f491b95b01 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048958 Apr 05 11:41:13.223050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 533/1046] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:14.045920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:14.047163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:14.054278 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:14.054932 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:14.055890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:14.056402 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:14.206008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:14.213749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-c1f9bd21-2c10-4dad-931f-590bd839631a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.172397 Apr 05 11:41:14.214423 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 514/1047] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:14 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:15.231083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:15.232441 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:15.239360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:15.239884 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:15.240674 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:15.241114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:15.383625 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:15.391631 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0c641768-8127-47d3-96bb-00a5ecb50b4e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.164755 Apr 05 11:41:15.392207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 534/1048] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:15 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:16.409291 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:16.409840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:16.416197 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:16.416654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:16.417425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:16.417870 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:16.556806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:16.564364 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-11d0831d-3e6b-414a-a326-11d95c035745 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.159132 Apr 05 11:41:16.564939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 515/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:16 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:17.581526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:17.582145 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:17.588554 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:17.589010 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:17.589783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:17.590226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:17.726652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:17.734551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fbe0b4f6-0a3a-425b-b847-7a7fafc1f70e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.156952 Apr 05 11:41:17.735164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 535/1050] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:17 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:18.752191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:18.752798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:18.759081 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:18.759559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:18.760317 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:18.760746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:18.895833 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:18.903589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cc452dad-99b1-4c52-a0dd-60d5aa701254 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.154993 Apr 05 11:41:18.904164 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 516/1051] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:18 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:19.922673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:19.923289 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:19.929903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:19.930356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:19.931131 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:19.931605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:20.062385 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:20.069623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-71feab39-3ea5-46e1-8d41-56cf39c680bc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.150824 Apr 05 11:41:20.070186 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 536/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:19 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:21.086143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:21.086714 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:21.093495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:21.095506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:21.095506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:21.095506 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:21.234107 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:21.241372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ddce5090-926c-42a0-abfd-0ea10b39af75 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.159214 Apr 05 11:41:21.241939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 517/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:21 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:22.258699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:22.259319 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:22.266030 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:22.266487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:22.267264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:22.267733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:22.408004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:22.415382 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-32b725f0-0311-4a4d-9947-7402ccf79478 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.160628 Apr 05 11:41:22.415979 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 537/1054] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:22 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:23.433661 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:23.434205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:23.440698 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:23.441156 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:23.441928 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:23.442379 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:23.577035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:23.584228 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d70cd47d-fa94-4290-97e4-919db32c001e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.154504 Apr 05 11:41:23.584789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 518/1055] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:23 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:24.601197 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:24.601814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:24.608736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:24.609191 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:24.609965 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:24.610399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:24.672812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:24.673382 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:24.679841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:24.680293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:24.681072 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:24.681507 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:24.705596 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-610f3891-bcdc-4858-b240-305c4fe11bea tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.037191 Apr 05 11:41:24.706181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 519/1056] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:41:24 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:41:24.747007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:24.754814 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e179c4e5-0aba-458a-a8c3-c533a692a955 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.157364 Apr 05 11:41:24.755611 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 538/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:24 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:25.771729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:25.772340 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:25.779241 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:25.779715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:25.780508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:25.780940 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:25.916615 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:25.924408 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d1eb6c0b-60e0-4621-a833-20dc7de05f4c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.156608 Apr 05 11:41:25.924972 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 520/1058] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:25 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:26.942211 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:26.942803 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:26.949242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:26.949700 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:26.950551 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:26.951827 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:27.089766 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:27.097518 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ce354c2-32e7-4b32-b71b-01b3969870a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.159247 Apr 05 11:41:27.098094 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 539/1059] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:26 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:28.113960 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:28.114568 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:28.120923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:28.121368 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:28.122125 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:28.122612 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:28.259217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:28.267205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8de1a829-20d3-476b-a5c9-917508166dab tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.157106 Apr 05 11:41:28.267798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 521/1060] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:28 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:29.019485 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-c2e2aaac-7459-424f-90af-fdd95d5eeb2d req-22e60172-f758-4b04-9442-5039e6f3dbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d592d6-a3fa-42be-8e0d-81b3932cf139", "name": "network-vif-plugged", "status": "completed", "tag": "4129f153-1ece-4259-82d8-7a290c87852d"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:29.027741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c2e2aaac-7459-424f-90af-fdd95d5eeb2d req-22e60172-f758-4b04-9442-5039e6f3dbeb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:29.028191 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c2e2aaac-7459-424f-90af-fdd95d5eeb2d req-22e60172-f758-4b04-9442-5039e6f3dbeb service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:29.039153 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-c2e2aaac-7459-424f-90af-fdd95d5eeb2d req-22e60172-f758-4b04-9442-5039e6f3dbeb service nova] Creating event network-vif-plugged:4129f153-1ece-4259-82d8-7a290c87852d for instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 on hv-cinder-83444 Apr 05 11:41:29.044685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-c2e2aaac-7459-424f-90af-fdd95d5eeb2d req-22e60172-f758-4b04-9442-5039e6f3dbeb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028502 Apr 05 11:41:29.045291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 540/1061] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:29.284486 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:29.285121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:29.291591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:29.292042 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:29.292819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:29.293256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:29.436032 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:29.440232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897501a2-dab1-48e9-a94a-31f98939ef45"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:29.441143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:29.446284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ea248868-ad61-4a01-8e2f-7f227e01bf79 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.165564 Apr 05 11:41:29.446864 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 522/1062] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:29 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:29.451851 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:29.452338 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:29.453173 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:29.453599 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:30.462400 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:30.463015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:30.470110 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:30.470566 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:30.471338 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:30.471806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:30.607663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:30.614981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-223dee5b-7227-4a0d-be36-8b2e1f82a2ae tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1267 microversion: 2.1 time: 0.156716 Apr 05 11:41:30.618681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 523/1063] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:30 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:41:30.971704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-704990ed-2b7c-41e0-9aae-6b9955759444 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "POST /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.535936 Apr 05 11:41:30.972847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 541/1064] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:41:29 2022] POST /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 194 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:41:31.634395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:31.634945 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:31.641668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:31.642121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:31.642887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:31.643329 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:31.797300 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:31.805405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4f8992c8-2b76-4a29-b97a-c6014762dd92 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1454 microversion: 2.1 time: 0.174982 Apr 05 11:41:31.805969 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 524/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:31 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:31.823764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:31.824460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:31.831133 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:31.831618 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:31.832384 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:31.832815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:31.967271 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:31.974711 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e1c0470-71b9-4e7b-abd7-e5b54361af72 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1454 microversion: 2.1 time: 0.155789 Apr 05 11:41:31.975300 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 542/1066] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:31 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:34.405290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-d2afeb69-e326-4136-afc2-95a032e532f4 req-17992531-fc6b-478c-8483-ee8849629980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d592d6-a3fa-42be-8e0d-81b3932cf139", "tag": "4129f153-1ece-4259-82d8-7a290c87852d"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:34.413599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d2afeb69-e326-4136-afc2-95a032e532f4 req-17992531-fc6b-478c-8483-ee8849629980 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:34.414044 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-d2afeb69-e326-4136-afc2-95a032e532f4 req-17992531-fc6b-478c-8483-ee8849629980 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:34.429522 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-d2afeb69-e326-4136-afc2-95a032e532f4 req-17992531-fc6b-478c-8483-ee8849629980 service nova] Creating event network-changed:4129f153-1ece-4259-82d8-7a290c87852d for instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 on hv-cinder-83444 Apr 05 11:41:34.435027 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-d2afeb69-e326-4136-afc2-95a032e532f4 req-17992531-fc6b-478c-8483-ee8849629980 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Apr 05 11:41:34.436536 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 525/1067] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:37.702630 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:37.703596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:37.709925 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:37.710376 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:37.711141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:37.711607 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:37.740916 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c6282e3b-29a7-4ecb-a413-5004ad94c77c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042547 Apr 05 11:41:37.741466 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 543/1068] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Apr 5 11:41:37 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:37.805478 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:37.806074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:37.813102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:37.813556 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:37.814326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:37.814761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:37.838943 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:41:38.094065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8618c1dd-6fff-4df8-99cf-b33684808e9c tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 204 len: 0 microversion: 2.20 time: 0.293568 Apr 05 11:41:38.099573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 526/1069] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Apr 5 11:41:37 2022] DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:41:38.103112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:38.103812 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:38.110309 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.110759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.111567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.112008 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.249400 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:38.257438 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:38.258987 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:38.260179 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c30f38a-3171-4865-b679-31f49a943985 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.161068 Apr 05 11:41:38.260744 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 544/1070] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:38 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:38.558452 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:38.559158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:38.565742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.566199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.566978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.567616 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.645668 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'services' on Instance uuid 312dd592-597c-40c9-88fb-502a44b126c1 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:41:38.859198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-cf791c0d-95c6-4fd9-8400-d8212336f2ab tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments/897501a2-dab1-48e9-a94a-31f98939ef45" status: 202 len: 0 microversion: 2.1 time: 0.304870 Apr 05 11:41:38.864474 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 527/1071] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:41:38 2022] DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments/897501a2-dab1-48e9-a94a-31f98939ef45 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:41:38.871302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:38.873157 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:38.879621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.880095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.880934 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:38.881396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:38.911232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-962f0cb8-c3fa-4c26-af4b-2949134bf853 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Apr 05 11:41:38.911823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 545/1072] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:38 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:39.279585 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:39.280293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:39.287149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:39.287675 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:39.288426 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:39.288905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:39.430831 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:39.439451 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:39.440997 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:39.442167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-88c209e8-50e9-4775-a735-18ea1871a1ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.167123 Apr 05 11:41:39.442730 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 528/1073] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:39 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:41:39.922472 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:39.923405 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:39.930181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:39.930658 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:39.931444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:39.931910 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:39.960850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a594d3b0-c780-4225-867c-715a8972a446 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Apr 05 11:41:39.961419 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 546/1074] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:39 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:40.461160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:40.461787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:40.468712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:40.469166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:40.469927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:40.470365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:40.599562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:40.607901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:40.609412 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:40.610575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-43eb9bd9-bc8b-4ca8-aa9b-74e3512a0f54 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.153769 Apr 05 11:41:40.611142 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 529/1075] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:40 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:40.972677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:40.973649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:40.979926 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:40.980376 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:40.981143 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:40.981579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:41.009296 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3441f3e4-6467-4524-b273-176d7134f722 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Apr 05 11:41:41.009847 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 547/1076] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:40 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:41.634548 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:41.635186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:41.643166 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:41.643656 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:41.644438 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:41.645031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:41.785287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:41.794625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:41.796714 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:41.797589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-7666f942-4112-4b36-9ab2-37b245c93f10 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.167008 Apr 05 11:41:41.798396 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 530/1077] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:41 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:42.023850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:42.025148 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:42.032359 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:42.032815 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:42.033601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:42.034044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:42.065074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c306734-943f-4d8c-a547-9b1283be1454 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047572 Apr 05 11:41:42.068783 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 548/1078] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:42 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:42.816194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:42.816813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:42.823190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:42.826552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:42.826552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:42.826552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:43.077564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:43.078575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:43.084153 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:43.085660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:43.086310 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:43.087292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:43.087929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:43.103076 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:43.104625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:43.107154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aac1069d-e7b8-4a5e-baef-12c919640aa2 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1721 microversion: 2.20 time: 0.293574 Apr 05 11:41:43.108593 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 531/1079] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:42 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:43.126634 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ba7359ee-675b-4578-928f-a91b834856e5 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052909 Apr 05 11:41:43.126634 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 549/1080] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:43 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:41:43.574208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-cdde38db-931b-4f93-859f-e0c69680da4e req-20ad4022-31cc-4bfc-b0b1-409f92aee0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88e619-6518-47fd-a6aa-5e4e90281f8c", "name": "network-vif-deleted", "tag": "781c46da-8de3-4fb3-bf2a-0909f6044870"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:43.587619 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-cdde38db-931b-4f93-859f-e0c69680da4e req-20ad4022-31cc-4bfc-b0b1-409f92aee0fe service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:43.588589 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-cdde38db-931b-4f93-859f-e0c69680da4e req-20ad4022-31cc-4bfc-b0b1-409f92aee0fe service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:43.606873 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-cdde38db-931b-4f93-859f-e0c69680da4e req-20ad4022-31cc-4bfc-b0b1-409f92aee0fe service nova] Creating event network-vif-deleted:781c46da-8de3-4fb3-bf2a-0909f6044870 for instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c on hv-cinder-83444 Apr 05 11:41:43.613067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-cdde38db-931b-4f93-859f-e0c69680da4e req-20ad4022-31cc-4bfc-b0b1-409f92aee0fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042793 Apr 05 11:41:43.618191 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 532/1081] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:44.126183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:44.126806 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:44.133238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.133980 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.134760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.135199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.137532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:44.138733 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:44.145764 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.146369 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.147163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.147704 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.172238 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.172702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.173162 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lazy-loading 'fault' on Instance uuid 4d88e619-6518-47fd-a6aa-5e4e90281f8c {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:41:44.184788 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-13ff1b55-3f63-47cf-af86-330f079107a1 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051830 Apr 05 11:41:44.185481 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 533/1082] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Apr 5 11:41:44 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:41:44.218416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:44.227740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:44.229268 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79180da3d5fd40d78032caf8d54dbcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d90e8ff5e4e72ad93b7b8123f9648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:44.241078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e818d5e-763c-4f0b-8a02-b298c9e394ba tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 200 len: 1369 microversion: 2.20 time: 0.120111 Apr 05 11:41:44.241649 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 550/1083] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:44 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:41:44.246995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:44.247790 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:44.254331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.254787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.255602 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.256036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.285035 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:41:44.917503 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e4668860-0857-4a16-b18d-7c83fdde3571 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 204 len: 0 microversion: 2.1 time: 0.672666 Apr 05 11:41:44.918100 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 534/1084] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:41:44 2022] DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:41:44.929931 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:44.930696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:44.936929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.937383 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:44.938170 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:44.938612 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:45.078596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:45.085946 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-091c394b-4560-40e7-b26d-b4be62bd122b tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1679 microversion: 2.1 time: 0.161118 Apr 05 11:41:45.087207 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 551/1085] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:44 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:45.260069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:45.268737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:45.269043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:45.269511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:45.270304 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:45.270746 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:45.285336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. Apr 05 11:41:45.285925 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:45.286840 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3670cacc-04a2-4535-ba92-5f78a38f521a tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 404 len: 111 microversion: 2.20 time: 0.031075 Apr 05 11:41:45.287448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 535/1086] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:45 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:41:45.295958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-71057664-7078-40a1-99f9-1d3e49af3d75 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '.version_select at 0x7f1382a475e0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:45.368903 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-71057664-7078-40a1-99f9-1d3e49af3d75 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-55828146" status: 204 len: 0 microversion: 2.20 time: 0.076648 Apr 05 11:41:45.369511 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 552/1087] 10.222.0.60 () {60 vars in 1255 bytes} [Tue Apr 5 11:41:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-55828146 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:41:46.106724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:46.107883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:46.113837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:46.114293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:46.115066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:46.115534 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:46.290903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:46.299796 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d2b0dcb0-0764-44df-bc4f-a5b28fe7ca64 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1679 microversion: 2.1 time: 0.196849 Apr 05 11:41:46.304836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 536/1088] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:46 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:47.318609 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:47.319304 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:47.326840 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.332219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.332219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.332219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.405908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:47.429633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1f0dc3c-be97-4403-8f74-90acdf686624 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1612 microversion: 2.1 time: 0.110078 Apr 05 11:41:47.429633 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 553/1089] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:47 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:47.444987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:47.445572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:47.453213 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.453676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.454469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.454910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.471862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. Apr 05 11:41:47.472473 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:47.473405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a5516f5b-5194-4386-9c47-3f9f9b811a80 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 404 len: 111 microversion: 2.20 time: 0.032530 Apr 05 11:41:47.473987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 537/1090] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Apr 5 11:41:47 2022] DELETE /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:41:47.482287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:47.483528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 4d88e619-6518-47fd-a6aa-5e4e90281f8c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:47.489610 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.490066 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.490852 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.491287 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.505404 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. Apr 05 11:41:47.506001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 4d88e619-6518-47fd-a6aa-5e4e90281f8c could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:47.506835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3decb57f-d383-43bf-a62b-e1d9ec5500bd tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c" status: 404 len: 111 microversion: 2.20 time: 0.028603 Apr 05 11:41:47.507390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 554/1091] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:47 2022] GET /compute/v2.1/servers/4d88e619-6518-47fd-a6aa-5e4e90281f8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:41:47.602457 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-68ab320a-cf8b-46d1-babc-cd53edc00027 req-4b28e390-b0d1-4f78-b4fc-01a083042491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312dd592-597c-40c9-88fb-502a44b126c1", "name": "network-vif-deleted", "tag": "c972cbda-2f1a-4d11-8109-75d7b53e0483"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:47.615103 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-68ab320a-cf8b-46d1-babc-cd53edc00027 req-4b28e390-b0d1-4f78-b4fc-01a083042491 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:47.615103 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-68ab320a-cf8b-46d1-babc-cd53edc00027 req-4b28e390-b0d1-4f78-b4fc-01a083042491 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:47.630024 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-68ab320a-cf8b-46d1-babc-cd53edc00027 req-4b28e390-b0d1-4f78-b4fc-01a083042491 service nova] Creating event network-vif-deleted:c972cbda-2f1a-4d11-8109-75d7b53e0483 for instance 312dd592-597c-40c9-88fb-502a44b126c1 on hv-cinder-83444 Apr 05 11:41:47.635025 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-68ab320a-cf8b-46d1-babc-cd53edc00027 req-4b28e390-b0d1-4f78-b4fc-01a083042491 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037405 Apr 05 11:41:47.635948 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 538/1092] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:48.444114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:48.444733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:48.451909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.452371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.453189 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.453619 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.490663 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.491125 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.491627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lazy-loading 'fault' on Instance uuid 312dd592-597c-40c9-88fb-502a44b126c1 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:41:48.538361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c75b53446424f4cad4b12129234d740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd629246f6ced4cc8b75399b7a0723868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:41:48.549499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d8468fb-37f7-45c9-bb5b-212f45e4105e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 200 len: 1330 microversion: 2.1 time: 0.109222 Apr 05 11:41:48.550622 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 555/1093] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:48 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:41:48.832167 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:48.833344 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:48.840672 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.841051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.841953 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.842917 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.856331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. Apr 05 11:41:48.860293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:48.860293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-03cc2605-5b74-49ef-b71c-33cc4a049292 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 404 len: 111 microversion: 2.20 time: 0.031664 Apr 05 11:41:48.860293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 539/1094] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Apr 5 11:41:48 2022] DELETE /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:41:48.866882 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:48.867546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] [instance: 5f678de2-5855-469b-8c6f-c89816e9b30e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:48.874409 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.874858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.875654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:48.876088 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:48.890154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] HTTP exception thrown: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. Apr 05 11:41:48.890736 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] Returning 404 to user: Instance 5f678de2-5855-469b-8c6f-c89816e9b30e could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:48.891577 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a52a7a71-c350-4ee0-ab33-5dcc90807f91 tempest-AttachVolumeShelveTestJSON-1013711739 tempest-AttachVolumeShelveTestJSON-1013711739-project] 10.222.0.60 "GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e" status: 404 len: 111 microversion: 2.20 time: 0.028481 Apr 05 11:41:48.892115 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 556/1095] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Apr 5 11:41:48 2022] GET /compute/v2.1/servers/5f678de2-5855-469b-8c6f-c89816e9b30e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:41:49.566645 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:49.567676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:49.576197 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:49.576891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:49.577578 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:49.578088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:49.592482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. Apr 05 11:41:49.593246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:49.594066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e28d0d5b-5368-441b-8150-301709bb6f86 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 404 len: 111 microversion: 2.1 time: 0.031887 Apr 05 11:41:49.599007 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 540/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:49 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:49.605966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-72db32c4-aabb-4867-92a1-9711c6c14c96 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '.version_select at 0x7f1382d748b0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:49.727482 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-72db32c4-aabb-4867-92a1-9711c6c14c96 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959893800" status: 202 len: 0 microversion: 2.1 time: 0.125226 Apr 05 11:41:49.728202 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 557/1097] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Apr 5 11:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959893800 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:41:52.044464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:52.045629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:52.052448 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:52.052910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:52.053686 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:52.054126 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:52.067938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. Apr 05 11:41:52.068545 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:52.069384 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d69eac8-668e-470b-bb08-6fa9c66c8995 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 404 len: 111 microversion: 2.1 time: 0.028738 Apr 05 11:41:52.069930 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 541/1098] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:41:52 2022] DELETE /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:41:52.078638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:52.079298 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 312dd592-597c-40c9-88fb-502a44b126c1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:52.089245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:52.089245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:52.089245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:52.089245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:52.102579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. Apr 05 11:41:52.103181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 312dd592-597c-40c9-88fb-502a44b126c1 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:52.104047 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1c019cb-4027-4b12-87bf-ca636215057f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1" status: 404 len: 111 microversion: 2.1 time: 0.029897 Apr 05 11:41:52.104593 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 558/1099] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:52 2022] GET /compute/v2.1/servers/312dd592-597c-40c9-88fb-502a44b126c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:53.393767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:53.394270 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:53.400631 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.401095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.401860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.402299 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.416243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. Apr 05 11:41:53.416831 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:53.417720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-961e1bbd-a5c2-4aba-9048-8ce987325a9e tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 404 len: 111 microversion: 2.1 time: 0.027967 Apr 05 11:41:53.418251 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 542/1100] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:41:53 2022] DELETE /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:53.427592 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:53.428216 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 3945b25c-4ebb-40d4-aa74-715634c40e57] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:53.434509 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.434963 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.435913 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.436276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.449837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. Apr 05 11:41:53.450426 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 3945b25c-4ebb-40d4-aa74-715634c40e57 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:53.451897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ee6e206c-4941-46f5-b1da-2d1b740ae9ff tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57" status: 404 len: 111 microversion: 2.1 time: 0.028507 Apr 05 11:41:53.452528 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 559/1101] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:53 2022] GET /compute/v2.1/servers/3945b25c-4ebb-40d4-aa74-715634c40e57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:53.460621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:53.461146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:53.468333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.468812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.469581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.470017 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.483367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. Apr 05 11:41:53.483987 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:53.484801 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-64fdcd4b-4d3c-4071-a124-88c9aca8bdef tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 404 len: 111 microversion: 2.1 time: 0.028143 Apr 05 11:41:53.485331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 543/1102] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:41:53 2022] DELETE /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:53.493183 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:53.493858 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 5bd641ff-56ae-409d-bc86-8d8edb85fedb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:53.500979 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.501285 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.502548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:53.502548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:53.519358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. Apr 05 11:41:53.520166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 5bd641ff-56ae-409d-bc86-8d8edb85fedb could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:53.520994 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c9a2b2e-a017-474d-b419-3b86c577a690 tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb" status: 404 len: 111 microversion: 2.1 time: 0.031690 Apr 05 11:41:53.521552 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 560/1103] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:53 2022] GET /compute/v2.1/servers/5bd641ff-56ae-409d-bc86-8d8edb85fedb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:54.876837 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:54.877336 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:54.887196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:54.887196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:54.887196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:54.887196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:54.898924 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. Apr 05 11:41:54.899538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:54.900405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3f07fe09-5d83-49a4-af7e-7aba294d964f tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 404 len: 111 microversion: 2.1 time: 0.027749 Apr 05 11:41:54.900955 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 544/1104] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:41:54 2022] DELETE /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:54.911333 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:54.912060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] [instance: 78373594-67e2-4cfc-8b01-6417123e373b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:41:54.919208 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:54.925818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:54.925818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:41:54.925818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:41:54.937448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] HTTP exception thrown: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. Apr 05 11:41:54.938038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] Returning 404 to user: Instance 78373594-67e2-4cfc-8b01-6417123e373b could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:41:54.938855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-261a3577-9156-4323-a4e9-b2024e8f73bb tempest-AttachVolumeNegativeTest-1940953974 tempest-AttachVolumeNegativeTest-1940953974-project] 10.222.0.60 "GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b" status: 404 len: 111 microversion: 2.1 time: 0.032972 Apr 05 11:41:54.939401 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 561/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:41:54 2022] GET /compute/v2.1/servers/78373594-67e2-4cfc-8b01-6417123e373b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:41:55.471787 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-43a17a30-4827-4260-85b0-2b0c0adaa1bd tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Action: 'create', calling method: .version_select at 0x7f13824d75e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2087043097"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:56.195625 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-43a17a30-4827-4260-85b0-2b0c0adaa1bd tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.845633 Apr 05 11:41:56.197063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 545/1106] 10.222.0.60 () {60 vars in 1154 bytes} [Tue Apr 5 11:41:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 848 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 11:41:56.207699 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d1e807c1-039e-4f3f-96fe-87637936997d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13837f55e0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:56.258446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d1e807c1-039e-4f3f-96fe-87637936997d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 200 len: 345 microversion: 2.1 time: 0.054404 Apr 05 11:41:56.259600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 562/1107] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:41:56 2022] GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:57.271511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b05a1fd9-cf9c-4480-bddf-546440b54cd0 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382511dc0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:57.319712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b05a1fd9-cf9c-4480-bddf-546440b54cd0 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 200 len: 346 microversion: 2.1 time: 0.052530 Apr 05 11:41:57.320276 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 546/1108] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:41:57 2022] GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:57.331984 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2991cc67-4537-4b38-b23a-5038ef3dd8f1 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Action: 'create', calling method: .version_select at 0x7f1382d18820>, body: {"snapshot": {"volume_id": "b9bc6ebd-35cb-414d-9731-c0d5c6b439c9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-459193462"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:41:57.900887 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2991cc67-4537-4b38-b23a-5038ef3dd8f1 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.573303 Apr 05 11:41:57.901467 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 563/1109] 10.222.0.60 () {60 vars in 1161 bytes} [Tue Apr 5 11:41:57 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:57.912327 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6d5c9293-8abf-43cd-9b10-3faa1a95fa19 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382368820>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:57.943381 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6d5c9293-8abf-43cd-9b10-3faa1a95fa19 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.034875 Apr 05 11:41:57.944508 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 547/1110] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:41:57 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:57.955486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15b76110-51e6-4c3d-ae19-e1dd6e2ffa33 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13837e3e50>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:57.988772 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15b76110-51e6-4c3d-ae19-e1dd6e2ffa33 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038107 Apr 05 11:41:57.989345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 564/1111] 10.222.0.60 () {58 vars in 1139 bytes} [Tue Apr 5 11:41:57 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:41:58.008273 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5bcb7630-a0c4-4742-9f34-be7b702b2392 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13823685e0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:58.029619 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5bcb7630-a0c4-4742-9f34-be7b702b2392 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.033424 Apr 05 11:41:58.030547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 548/1112] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:41:57 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:41:59.042235 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f16f1542-5870-4720-9f1e-22a1ebe32826 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382a8c430>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:41:59.080126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f16f1542-5870-4720-9f1e-22a1ebe32826 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.042258 Apr 05 11:41:59.080878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 565/1113] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:41:59 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:00.093090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4d35a109-b6ef-4539-bff3-81488914193f tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13824d7790>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:00.123546 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4d35a109-b6ef-4539-bff3-81488914193f tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.034470 Apr 05 11:42:00.124427 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 549/1114] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:42:00 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:01.135775 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d70cd881-355a-4b62-89d6-c073f1999f85 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382c05e50>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:01.166592 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d70cd881-355a-4b62-89d6-c073f1999f85 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.035005 Apr 05 11:42:01.167107 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 566/1115] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:42:01 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:02.180043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9c8b1ee1-5190-4aa7-a42c-5c0d807e493f tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382368ee0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:02.268753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9c8b1ee1-5190-4aa7-a42c-5c0d807e493f tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 287 microversion: 2.1 time: 0.093774 Apr 05 11:42:02.269450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 550/1116] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:42:02 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:02.284388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40b184a3-3282-4994-85f5-86b3e79bc086 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382e051f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:02.558705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40b184a3-3282-4994-85f5-86b3e79bc086 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 202 len: 0 microversion: 2.1 time: 0.273975 Apr 05 11:42:02.558705 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 567/1117] 10.222.0.60 () {58 vars in 1253 bytes} [Tue Apr 5 11:42:02 2022] DELETE /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:42:02.564893 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-51d679c9-0364-4414-9e58-4fa023ccad7c tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382368a60>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:02.612815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-51d679c9-0364-4414-9e58-4fa023ccad7c tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 200 len: 286 microversion: 2.1 time: 0.046683 Apr 05 11:42:02.612815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 551/1118] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:42:02 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:03.622001 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-404e01e4-5afc-44f2-ae60-b9dba498cc58 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13837f5f70>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:03.646227 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-404e01e4-5afc-44f2-ae60-b9dba498cc58 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] HTTP exception thrown: Snapshot 964cd3e3-c83a-46d6-8983-837bf253dc14 could not be found. Apr 05 11:42:03.647295 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-404e01e4-5afc-44f2-ae60-b9dba498cc58 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Returning 404 to user: Snapshot 964cd3e3-c83a-46d6-8983-837bf253dc14 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:42:03.648276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-404e01e4-5afc-44f2-ae60-b9dba498cc58 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14" status: 404 len: 111 microversion: 2.1 time: 0.030147 Apr 05 11:42:03.648828 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 568/1119] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Apr 5 11:42:03 2022] GET /compute/v2.1/os-snapshots/964cd3e3-c83a-46d6-8983-837bf253dc14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:42:03.658502 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2abd948f-d5d5-4f42-b94c-f3563b369d48 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13824e5670>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:03.829887 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2abd948f-d5d5-4f42-b94c-f3563b369d48 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 202 len: 0 microversion: 2.1 time: 0.176669 Apr 05 11:42:03.833934 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 552/1120] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:42:03 2022] DELETE /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:42:03.839855 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ef4ccc3-5b15-4caf-b1e0-5fbea4c511c5 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382a479d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:03.887083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ef4ccc3-5b15-4caf-b1e0-5fbea4c511c5 tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 200 len: 345 microversion: 2.1 time: 0.050926 Apr 05 11:42:03.887741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 569/1121] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:42:03 2022] GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:42:04.902562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-10985618-5b00-4d03-807f-c497b014632a tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13824cadc0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:04.937132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-10985618-5b00-4d03-807f-c497b014632a tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] HTTP exception thrown: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. Apr 05 11:42:04.937776 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-10985618-5b00-4d03-807f-c497b014632a tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Returning 404 to user: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:42:04.938628 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-10985618-5b00-4d03-807f-c497b014632a tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 404 len: 109 microversion: 2.1 time: 0.041342 Apr 05 11:42:04.939177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 553/1122] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:42:04 2022] GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:42:04.956606 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-34a2205d-a084-49c0-b379-a0a130250beb tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f1382d6e160>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:04.989328 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-34a2205d-a084-49c0-b379-a0a130250beb tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] HTTP exception thrown: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. Apr 05 11:42:04.990539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-34a2205d-a084-49c0-b379-a0a130250beb tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Returning 404 to user: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:42:04.991403 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-34a2205d-a084-49c0-b379-a0a130250beb tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 404 len: 109 microversion: 2.1 time: 0.041722 Apr 05 11:42:04.992281 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 570/1123] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Apr 5 11:42:04 2022] DELETE /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:42:05.002227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ac89efc9-3292-466b-b2bf-d2a6a986ee9d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Calling method '.version_select at 0x7f13824e53a0>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:42:05.033814 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-ac89efc9-3292-466b-b2bf-d2a6a986ee9d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] HTTP exception thrown: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. Apr 05 11:42:05.034538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ac89efc9-3292-466b-b2bf-d2a6a986ee9d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] Returning 404 to user: Volume b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:42:05.035581 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ac89efc9-3292-466b-b2bf-d2a6a986ee9d tempest-VolumesSnapshotsTestJSON-660586293 tempest-VolumesSnapshotsTestJSON-660586293-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9" status: 404 len: 109 microversion: 2.1 time: 0.038545 Apr 05 11:42:05.037163 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 554/1124] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Apr 5 11:42:04 2022] GET /compute/v2.1/os-volumes/b9bc6ebd-35cb-414d-9731-c0d5c6b439c9 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:43:31.217020 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:31.217579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:31.224702 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:31.225232 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:31.226129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:31.226567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:31.251444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:43:31.613403 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4746c7e-f244-4499-ad27-57c6c0bcd3a7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 204 len: 0 microversion: 2.1 time: 0.402064 Apr 05 11:43:31.614181 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 571/1125] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:43:31 2022] DELETE /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:43:31.620394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: ERROR oslo.messaging._drivers.impl_rabbit [-] [af30a986-be6e-4e13-b2f4-a12bc4c5b448] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 11:43:31.627995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:31.627995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:31.634028 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:31.634540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:31.635316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:31.635779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:31.775242 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:31.782765 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6df75343-9904-4cce-9763-03c5d9bba6cc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1578 microversion: 2.1 time: 0.164095 Apr 05 11:43:31.783333 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 555/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:31 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:32.800972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:32.802037 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:32.807989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:32.808440 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:32.809209 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:32.809646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:32.962218 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:32.970755 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73cc72dc-2e21-48cf-b020-35e5b5e0a49b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1578 microversion: 2.1 time: 0.174348 Apr 05 11:43:32.971322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 572/1127] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:32 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:33.987886 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:33.988587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:33.996982 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:33.997449 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:33.998392 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:33.998883 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:34.025832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] [af30a986-be6e-4e13-b2f4-a12bc4c5b448] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39382. Apr 05 11:43:34.230181 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:34.237749 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-90d0de25-3106-4417-bb85-ad40e653af36 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1578 microversion: 2.1 time: 0.253792 Apr 05 11:43:34.238322 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 556/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:33 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:34.476686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-1275223e-9615-4193-8c47-9dba0561e3a2 req-d3d097a6-b91b-439c-918c-0f779a957714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d592d6-a3fa-42be-8e0d-81b3932cf139", "name": "network-vif-deleted", "tag": "4129f153-1ece-4259-82d8-7a290c87852d"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:34.489142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1275223e-9615-4193-8c47-9dba0561e3a2 req-d3d097a6-b91b-439c-918c-0f779a957714 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:34.489142 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-1275223e-9615-4193-8c47-9dba0561e3a2 req-d3d097a6-b91b-439c-918c-0f779a957714 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:34.499902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-1275223e-9615-4193-8c47-9dba0561e3a2 req-d3d097a6-b91b-439c-918c-0f779a957714 service nova] Creating event network-vif-deleted:4129f153-1ece-4259-82d8-7a290c87852d for instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 on hv-cinder-83444 Apr 05 11:43:34.505878 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-1275223e-9615-4193-8c47-9dba0561e3a2 req-d3d097a6-b91b-439c-918c-0f779a957714 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033400 Apr 05 11:43:34.509909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 573/1129] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:35.263071 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:35.263071 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:35.267065 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:35.267543 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:35.268388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:35.268813 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:35.300721 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:35.301297 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:35.301832 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lazy-loading 'fault' on Instance uuid e1d592d6-a3fa-42be-8e0d-81b3932cf139 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:43:35.350575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:35.358537 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e80da08b-d686-4916-b8cb-81403f34c0aa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 200 len: 1231 microversion: 2.1 time: 0.107644 Apr 05 11:43:35.359244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 557/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:35 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:43:36.376915 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:36.377866 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:36.384454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:36.384912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:36.385706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:36.386149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:36.399543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] HTTP exception thrown: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. Apr 05 11:43:36.400147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Returning 404 to user: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:43:36.400975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c92f88e-6404-40cf-b1e9-8e05df3ff381 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 404 len: 111 microversion: 2.1 time: 0.028710 Apr 05 11:43:36.401524 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 574/1131] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:36 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:43:36.505034 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2145800910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098956905", "security_groups": [{"name": "tempest-secgroup-smoke-1021731976"}], "block_device_mapping_v2": [{"uuid": "22836e2a-9bec-40f1-81b3-c463efe55f44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6351c4b7-133d-4471-82de-f39f3c9f175f"}]}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:36.617517 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.network.neutron [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] validate_networks() for [('6351c4b7-133d-4471-82de-f39f3c9f175f', None, None, None, None, None)] {{(pid=124243) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:43:37.008211 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:43:37.008644 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image limits 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:43:37.009122 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:43:37.009531 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image pref 0:0:0 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:43:37.009980 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.virt.hardware [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:43:37.022301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:37.022301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:37.022301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:37.022301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:37.038337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:43:37.042249 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.quota [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for user 3b1109ba42564e7fb2e1e831fdc09280 and project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:43:37.098889 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Going to run 1 instances... {{(pid=124243) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:43:37.101036 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22836e2a-9bec-40f1-81b3-c463efe55f44',volume_size=None,volume_type=None)] {{(pid=124243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:43:37.514599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-35086aef-999e-4a29-8d6c-7a8171a4852c tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013363 Apr 05 11:43:37.519372 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 558/1132] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:43:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:43:37.525272 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5852fb8a-2502-4d54-8ad6-450040d06673 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:37.525888 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5852fb8a-2502-4d54-8ad6-450040d06673 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:37.582018 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5852fb8a-2502-4d54-8ad6-450040d06673 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:37.588678 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5852fb8a-2502-4d54-8ad6-450040d06673 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1095 microversion: 2.1 time: 0.067301 Apr 05 11:43:37.589246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 575/1133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:37 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:38.606539 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-184b9033-54f0-47a3-b936-2fd4a8f285d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:38.607325 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-184b9033-54f0-47a3-b936-2fd4a8f285d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:38.659809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-184b9033-54f0-47a3-b936-2fd4a8f285d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:38.666253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-184b9033-54f0-47a3-b936-2fd4a8f285d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1095 microversion: 2.1 time: 0.063983 Apr 05 11:43:38.666841 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 559/1134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:38 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:39.683972 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e712cfd0-40f1-4f4e-a733-50d4bfd6f52b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:39.684623 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e712cfd0-40f1-4f4e-a733-50d4bfd6f52b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:39.738564 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e712cfd0-40f1-4f4e-a733-50d4bfd6f52b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:39.745114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e712cfd0-40f1-4f4e-a733-50d4bfd6f52b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1095 microversion: 2.1 time: 0.065051 Apr 05 11:43:39.745682 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 576/1135] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:39 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:40.761663 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-eb332e5c-c832-453d-b435-b7aaa98a76a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:40.762274 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-eb332e5c-c832-453d-b435-b7aaa98a76a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:40.817587 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eb332e5c-c832-453d-b435-b7aaa98a76a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:40.824637 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-eb332e5c-c832-453d-b435-b7aaa98a76a5 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1095 microversion: 2.1 time: 0.066727 Apr 05 11:43:40.825289 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 560/1136] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:40 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:41.842069 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:41.842713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:41.849598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:41.850074 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:41.850845 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:41.851284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:41.913381 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:41.920770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5c40e83-1c1b-46df-a80f-0e00df4b9f5a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1145 microversion: 2.1 time: 0.082648 Apr 05 11:43:41.921330 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 577/1137] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:41 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:42.938349 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:42.938968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:42.951309 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:42.951798 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:42.952613 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:42.953125 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:43.029983 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:43.038242 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b4bb3289-7f1b-4ee3-843a-db344597cb18 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1201 microversion: 2.1 time: 0.104037 Apr 05 11:43:43.038903 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 561/1138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:42 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:44.056434 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:44.057052 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:44.064575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:44.065026 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:44.065820 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:44.066258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:44.221741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:44.230211 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-518b628f-1457-4399-8c24-f118deb1da23 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1279 microversion: 2.1 time: 0.177562 Apr 05 11:43:44.230880 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 578/1139] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:44 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:44.994995 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-360882d7-99ac-4c4e-8154-295aff18fb7b req-33b4aa8c-07bd-4324-be9c-da25bfc24e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514febd1-349b-4439-8ba2-62889b067381", "tag": "449dbab4-b7db-4b76-9262-6f3cd9a7eae2"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:43:45.003968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-360882d7-99ac-4c4e-8154-295aff18fb7b req-33b4aa8c-07bd-4324-be9c-da25bfc24e55 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:45.004425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-360882d7-99ac-4c4e-8154-295aff18fb7b req-33b4aa8c-07bd-4324-be9c-da25bfc24e55 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:45.017350 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-360882d7-99ac-4c4e-8154-295aff18fb7b req-33b4aa8c-07bd-4324-be9c-da25bfc24e55 service nova] Creating event network-changed:449dbab4-b7db-4b76-9262-6f3cd9a7eae2 for instance 514febd1-349b-4439-8ba2-62889b067381 on hv-cinder-83444 Apr 05 11:43:45.024118 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-360882d7-99ac-4c4e-8154-295aff18fb7b req-33b4aa8c-07bd-4324-be9c-da25bfc24e55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Apr 05 11:43:45.024742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 562/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:43:45.248038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:45.248597 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:45.254997 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:45.255484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:45.256266 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:45.256706 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:45.553311 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:45.560660 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c59f992f-1d7d-44fa-870f-bb09e4b5af14 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.316535 Apr 05 11:43:45.561233 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 579/1141] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:45 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:46.578790 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:46.579538 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:46.586140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:46.586591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:46.587366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:46.587830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:46.780051 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:46.787388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5872840d-44f9-4094-9ef7-ab7efd3a8282 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.213445 Apr 05 11:43:46.787976 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 563/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:46 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:47.803871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:47.804488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:47.810745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:47.811196 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:47.811996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:47.812493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:47.948140 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:47.956832 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0d23aa9-5eb0-4021-8a9f-b26ba158a194 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.156888 Apr 05 11:43:47.957395 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 580/1143] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:47 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:48.974992 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:48.975654 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:48.982069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:48.982516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:48.983282 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:48.983745 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:49.120174 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:49.127687 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-07f7ee14-5ab9-4b1b-af5f-a0e679c98723 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.156596 Apr 05 11:43:49.128254 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 564/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:48 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:49.767966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:43:49.768488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:43:50.144635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:50.145252 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:50.151821 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:50.152212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:50.152975 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:50.153409 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:50.290092 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:50.298652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17b1bce7-23f9-44e1-a2ee-6fa683ba25e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.157878 Apr 05 11:43:50.299219 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 581/1145] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:50 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:51.315058 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:51.315719 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:51.322237 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:51.322737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:51.323542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:51.324031 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:51.461697 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:51.471402 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0407e82f-456e-4cf4-97cd-0a6aeaa73a50 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.160849 Apr 05 11:43:51.479707 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 565/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:51 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:52.488480 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:52.489103 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:52.495726 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:52.496185 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:52.496964 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:52.497407 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:52.636126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:52.644077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-00fb66a7-d1a9-46b8-bec7-997a7e0c1bde tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.159646 Apr 05 11:43:52.644646 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 582/1147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:52 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:52.905681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:43:52.906158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:43:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:43:53.661511 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:53.662050 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:53.668424 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:53.668880 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:53.669652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:53.670093 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:53.814067 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:53.821302 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e1405f64-c7b0-45a5-b0d1-e211e3cfb8f2 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.163784 Apr 05 11:43:53.821871 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 566/1148] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:53 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:54.839308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:54.840118 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:54.846951 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:54.847402 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:54.848199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:54.848635 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:54.986290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:54.993641 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2094bed3-7733-4187-89bf-cff8dd2fdeaa tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.158036 Apr 05 11:43:54.994222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 583/1149] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:54 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:56.009920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:56.010529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:56.017541 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:56.017988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:56.018747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:56.019178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:56.151558 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:56.159235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-06089a3c-57c3-4bfa-b8e6-f0f250230f6f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.153109 Apr 05 11:43:56.159826 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 567/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:56 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:57.176486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:57.177034 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:57.183390 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:57.183871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:57.184652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:57.185085 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:57.321446 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:57.329523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e34fe6a-5b82-49ef-a204-748daad53602 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.157033 Apr 05 11:43:57.330098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 584/1151] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:57 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:43:58.346808 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:58.347444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:58.354004 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:58.354464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:58.355244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:58.355774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:58.495824 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:58.503819 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-76b084e4-a36c-4f96-a46a-19ea67339dcc tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.161566 Apr 05 11:43:58.504444 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 568/1152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:58 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:43:59.520499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:43:59.521101 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:43:59.527451 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:59.527897 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:59.528665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:43:59.529104 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:43:59.671052 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:43:59.679029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8cf770e-5974-4201-967c-129531297a24 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.162454 Apr 05 11:43:59.679634 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 585/1153] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:43:59 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:00.696828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:00.697450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:00.704198 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:00.704657 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:00.705434 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:00.705875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:00.844199 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:00.851765 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d5d618aa-bc85-4fff-8de7-17076c7d4e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.159103 Apr 05 11:44:00.852335 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 569/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:00 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:01.869529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:01.870162 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:01.877491 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:01.878121 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:01.878996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:01.879488 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:02.060249 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:02.068487 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c1308f9c-9acc-47d1-980a-0b35d0d9f518 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.202989 Apr 05 11:44:02.069062 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 586/1155] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:01 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:03.085318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:03.086033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:03.092623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:03.093083 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:03.094159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:03.094652 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:03.234221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:03.241988 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-593da420-57b3-4d4a-9f87-2700ea5236b9 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.160516 Apr 05 11:44:03.242674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 570/1156] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:03 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:03.533789 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:44:03.534370 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:44:03.778545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-feacace7-5450-436c-b850-ffd5f16e8ef2 req-9ae4ebd4-4623-4dbf-95e1-bf6cf3152d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514febd1-349b-4439-8ba2-62889b067381", "name": "network-vif-plugged", "status": "completed", "tag": "449dbab4-b7db-4b76-9262-6f3cd9a7eae2"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:03.787361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-feacace7-5450-436c-b850-ffd5f16e8ef2 req-9ae4ebd4-4623-4dbf-95e1-bf6cf3152d04 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:03.787849 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-feacace7-5450-436c-b850-ffd5f16e8ef2 req-9ae4ebd4-4623-4dbf-95e1-bf6cf3152d04 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:03.800095 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-feacace7-5450-436c-b850-ffd5f16e8ef2 req-9ae4ebd4-4623-4dbf-95e1-bf6cf3152d04 service nova] Creating event network-vif-plugged:449dbab4-b7db-4b76-9262-6f3cd9a7eae2 for instance 514febd1-349b-4439-8ba2-62889b067381 on hv-cinder-83444 Apr 05 11:44:03.805364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-feacace7-5450-436c-b850-ffd5f16e8ef2 req-9ae4ebd4-4623-4dbf-95e1-bf6cf3152d04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030468 Apr 05 11:44:03.805968 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 587/1157] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:04.259586 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:04.260231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:04.276292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:04.286965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:04.286965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:04.286965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:04.453246 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:04.460651 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-592741d0-c77e-491a-a157-795be848c962 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.204919 Apr 05 11:44:04.461216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 571/1158] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:04 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:05.343308 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1329467257", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:05.393518 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] validate_networks() for None {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:44:05.478063 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:05.480082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:05.484906 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:05.485363 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:05.486143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:05.486582 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:05.636188 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:05.644964 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-84918eaa-6752-415b-8b70-a46c00567747 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1267 microversion: 2.1 time: 0.170629 Apr 05 11:44:05.645475 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 572/1159] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:05 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:05.673005 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:44:05.673450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:44:05.673921 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:44:05.674337 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:44:05.674756 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:44:05.683765 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:05.684226 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:05.685042 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:05.685485 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:05.703448 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Getting quotas for project 3259730fc078424085aab847a2b7ec52. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:44:05.707432 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Getting quotas for user af025ed0432442ecb2def6f9ebec7278 and project 3259730fc078424085aab847a2b7ec52. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:44:05.725124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:44:05.727636 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:44:05.859569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-61c5bdd6-5ddb-45c1-84d7-b1a70673f05f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519887 Apr 05 11:44:05.860462 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 588/1160] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:44:05.870562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0caa6a91-edb8-448c-a73d-cad2ed5c692a tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:05.871646 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0caa6a91-edb8-448c-a73d-cad2ed5c692a tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:05.943354 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0caa6a91-edb8-448c-a73d-cad2ed5c692a tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:05.950713 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0caa6a91-edb8-448c-a73d-cad2ed5c692a tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1215 microversion: 2.1 time: 0.084147 Apr 05 11:44:05.951287 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 573/1161] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:05 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:06.664251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:06.664710 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:06.671791 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:06.672358 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:06.672983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:06.673424 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:06.818854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:06.826350 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ff7cd66-3fa0-40e7-97b6-5d2dc6fc2a1e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1455 microversion: 2.1 time: 0.166126 Apr 05 11:44:06.826986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 589/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:06 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:06.846165 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:06.847367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:06.854390 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:06.855061 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:06.855875 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:06.856301 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:06.967685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f47285f1-d208-402f-8e86-2683f1bc1b9d tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:06.968728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f47285f1-d208-402f-8e86-2683f1bc1b9d tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:07.024742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:07.024742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-56198a1e-e054-4f4e-96cc-adfc901b71f7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1455 microversion: 2.1 time: 0.181507 Apr 05 11:44:07.025862 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 574/1163] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:06 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:07.034567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f47285f1-d208-402f-8e86-2683f1bc1b9d tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:07.043294 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f47285f1-d208-402f-8e86-2683f1bc1b9d tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1215 microversion: 2.1 time: 0.079687 Apr 05 11:44:07.044230 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 590/1164] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:06 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:08.061931 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:08.062966 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:08.069986 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:08.070433 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:08.071450 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:08.072043 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:08.156087 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:08.166996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0a37230b-4d0d-4555-a17d-6c3944a36556 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1211 microversion: 2.1 time: 0.109881 Apr 05 11:44:08.178588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 575/1165] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:08 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:09.193477 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:09.194733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:09.203484 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:09.203874 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:09.204668 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:09.205112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:09.270117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:09.277584 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c266733-34ac-40b8-819c-950cffa66083 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1275 microversion: 2.1 time: 0.088250 Apr 05 11:44:09.278299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 591/1166] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:09 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:10.278902 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-e370cd46-a186-4564-8680-37b4d72a2b67 req-8dc97e62-482f-42e6-ad54-266eeef9a402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514febd1-349b-4439-8ba2-62889b067381", "tag": "449dbab4-b7db-4b76-9262-6f3cd9a7eae2"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:10.288409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e370cd46-a186-4564-8680-37b4d72a2b67 req-8dc97e62-482f-42e6-ad54-266eeef9a402 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:10.288859 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e370cd46-a186-4564-8680-37b4d72a2b67 req-8dc97e62-482f-42e6-ad54-266eeef9a402 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:10.305696 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-e370cd46-a186-4564-8680-37b4d72a2b67 req-8dc97e62-482f-42e6-ad54-266eeef9a402 service nova] Creating event network-changed:449dbab4-b7db-4b76-9262-6f3cd9a7eae2 for instance 514febd1-349b-4439-8ba2-62889b067381 on hv-cinder-83444 Apr 05 11:44:10.305843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:10.305843 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:10.308214 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-e370cd46-a186-4564-8680-37b4d72a2b67 req-8dc97e62-482f-42e6-ad54-266eeef9a402 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 Apr 05 11:44:10.308915 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 576/1167] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:10.319971 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:10.320436 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:10.321614 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:10.322240 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:10.423662 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:10.441902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28b42421-11a0-461a-abc4-597c3be65ea4 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1273 microversion: 2.1 time: 0.150113 Apr 05 11:44:10.454064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 592/1168] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:10 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:11.463624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:11.465048 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:11.471690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:11.472464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:11.473352 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:11.473890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:11.655148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:11.662851 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-541b5d0b-972a-43e3-a350-6d033edd6bb2 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.204317 Apr 05 11:44:11.663410 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 577/1169] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:11 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:12.066565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1522627940", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "networks": [{"uuid": "0e6ee671-44a9-446f-bc37-a1b71dd0faeb"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:12.121060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] validate_networks() for [('0e6ee671-44a9-446f-bc37-a1b71dd0faeb', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:44:12.331082 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-0661df6f-7281-4c72-850a-3ab29ca1bf3f req-fa886f0e-3507-4207-8039-2550859598e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3499fa68-d897-41ee-99e5-ea8e9311fafe", "tag": "829f1bcb-c135-4ba4-af8b-640f29281c32"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:12.339624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0661df6f-7281-4c72-850a-3ab29ca1bf3f req-fa886f0e-3507-4207-8039-2550859598e7 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:12.340369 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-0661df6f-7281-4c72-850a-3ab29ca1bf3f req-fa886f0e-3507-4207-8039-2550859598e7 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:12.368884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-0661df6f-7281-4c72-850a-3ab29ca1bf3f req-fa886f0e-3507-4207-8039-2550859598e7 service nova] Creating event network-changed:829f1bcb-c135-4ba4-af8b-640f29281c32 for instance 3499fa68-d897-41ee-99e5-ea8e9311fafe on hv-cinder-83444 Apr 05 11:44:12.377763 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-0661df6f-7281-4c72-850a-3ab29ca1bf3f req-fa886f0e-3507-4207-8039-2550859598e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051889 Apr 05 11:44:12.379179 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 578/1170] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:12.559282 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:44:12.559762 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:44:12.560245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:44:12.560659 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:44:12.561077 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:44:12.570548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:12.571003 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:12.571850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:12.572292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:12.589464 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Getting quotas for project 0493643a9a404b79b3a8036cfc7df40b. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:44:12.593249 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Getting quotas for user accca93ba1ae48818d9fce0012acda6e and project 0493643a9a404b79b3a8036cfc7df40b. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:44:12.604624 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:44:12.606760 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:44:12.683337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.684255 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:12.691256 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:12.691856 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:12.692709 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:12.693230 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:12.788117 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-75017ef5-85d1-4ced-8c90-83c4f7772cdb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726532 Apr 05 11:44:12.789165 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 593/1171] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:44:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:44:12.801253 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67513614-fcbe-4e3d-b927-4684ee0da48e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:12.802091 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67513614-fcbe-4e3d-b927-4684ee0da48e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:12.861405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:12.862220 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67513614-fcbe-4e3d-b927-4684ee0da48e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:12.869195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-90e3d050-4439-495d-93a9-ea1c86423be7 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.191222 Apr 05 11:44:12.878985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 579/1172] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:12.879229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67513614-fcbe-4e3d-b927-4684ee0da48e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1219 microversion: 2.1 time: 0.075632 Apr 05 11:44:12.879229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 594/1173] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:12 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:13.886367 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:13.886985 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:13.888191 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7ef9211-5f7b-49a0-9d3a-b917beea765a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:13.888953 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7ef9211-5f7b-49a0-9d3a-b917beea765a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:13.895094 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:13.895802 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:13.896690 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:13.897127 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:13.942046 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b7ef9211-5f7b-49a0-9d3a-b917beea765a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:13.948993 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7ef9211-5f7b-49a0-9d3a-b917beea765a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1219 microversion: 2.1 time: 0.064508 Apr 05 11:44:13.949793 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 595/1174] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:13 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:14.143132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:14.153759 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0fbe9b08-982d-42e9-92be-ef0b62186f6c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.271195 Apr 05 11:44:14.154733 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 580/1175] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:13 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:14.966457 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:14.967065 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:14.974559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:14.975035 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:14.975836 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:14.979212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:15.035380 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:15.042740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc8a36f3-4b99-408f-857a-b1dab1f68937 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1215 microversion: 2.1 time: 0.080103 Apr 05 11:44:15.043526 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 596/1176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:14 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:15.173673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:15.174290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:15.180681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:15.181132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:15.181892 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:15.182357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:15.320638 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:15.328158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1e9ba7e5-173d-46e5-aeb3-956628c6c885 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.158557 Apr 05 11:44:15.329158 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 581/1177] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:15 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:16.060753 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:16.061354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:16.068264 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:16.068717 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:16.069490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:16.069927 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:16.344884 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:16.345588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:16.352792 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:16.353332 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:16.354221 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:16.354729 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:16.390087 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:16.403360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-758a1071-a4a1-4e0e-ac90-b3fef2352c58 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1289 microversion: 2.1 time: 0.341231 Apr 05 11:44:16.403360 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 597/1178] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:16 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1289 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:16.586681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:16.594624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-42cb40b1-7cf5-484e-bfc4-9ef5d4585e1f tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.253609 Apr 05 11:44:16.595253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 582/1179] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:16 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:17.416485 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:17.417102 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:17.424345 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:17.430768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:17.430768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:17.430768 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:17.473799 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-37e817a9-0be8-4f0d-b416-cd4fecd8367a req-2871517a-d7a4-4978-9428-73bbae3ca159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a524e514-20e8-46f6-a7c6-7d2e96e89d4e", "tag": "9f148526-7b17-4fe7-aa34-3b0c38b99339"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:17.482896 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-37e817a9-0be8-4f0d-b416-cd4fecd8367a req-2871517a-d7a4-4978-9428-73bbae3ca159 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:17.483495 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-37e817a9-0be8-4f0d-b416-cd4fecd8367a req-2871517a-d7a4-4978-9428-73bbae3ca159 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:17.496983 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-37e817a9-0be8-4f0d-b416-cd4fecd8367a req-2871517a-d7a4-4978-9428-73bbae3ca159 service nova] Creating event network-changed:9f148526-7b17-4fe7-aa34-3b0c38b99339 for instance a524e514-20e8-46f6-a7c6-7d2e96e89d4e on hv-cinder-83444 Apr 05 11:44:17.508860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-37e817a9-0be8-4f0d-b416-cd4fecd8367a req-2871517a-d7a4-4978-9428-73bbae3ca159 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039861 Apr 05 11:44:17.509477 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 583/1180] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:17.569039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:17.577497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e6dc4f9-55bb-4519-8006-3490bb22f91b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.164809 Apr 05 11:44:17.578290 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 598/1181] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:17 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:44:17.612347 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:17.613046 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:17.619337 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:17.626789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:17.626789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:17.626789 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:17.861461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:17.869551 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ce44fd69-f64e-47f8-87b6-344d31e7b925 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.261869 Apr 05 11:44:17.870446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 584/1182] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:17 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:18.048631 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-b8695021-bac4-4f6e-a69e-ed7bd53c0bd3 req-1eaa40b7-77a2-4128-8a81-d6bba5654ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3499fa68-d897-41ee-99e5-ea8e9311fafe", "name": "network-vif-plugged", "status": "completed", "tag": "829f1bcb-c135-4ba4-af8b-640f29281c32"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:18.057011 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b8695021-bac4-4f6e-a69e-ed7bd53c0bd3 req-1eaa40b7-77a2-4128-8a81-d6bba5654ab7 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:18.057497 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b8695021-bac4-4f6e-a69e-ed7bd53c0bd3 req-1eaa40b7-77a2-4128-8a81-d6bba5654ab7 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:18.068924 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-b8695021-bac4-4f6e-a69e-ed7bd53c0bd3 req-1eaa40b7-77a2-4128-8a81-d6bba5654ab7 service nova] Creating event network-vif-plugged:829f1bcb-c135-4ba4-af8b-640f29281c32 for instance 3499fa68-d897-41ee-99e5-ea8e9311fafe on hv-cinder-83444 Apr 05 11:44:18.073883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-b8695021-bac4-4f6e-a69e-ed7bd53c0bd3 req-1eaa40b7-77a2-4128-8a81-d6bba5654ab7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029208 Apr 05 11:44:18.074479 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 599/1183] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:18.594622 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:18.595232 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:18.601485 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:18.601927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:18.602731 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:18.603160 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:18.744303 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:18.752130 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-737913fe-d718-48ac-829b-f171d01e0342 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.161897 Apr 05 11:44:18.752693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 585/1184] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:18 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:18.887709 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:18.888493 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:18.895343 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:18.895831 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:18.896666 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:18.897112 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:19.033064 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:19.040361 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c8173c6-7ae4-4dc2-9d6c-59f944601d20 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.157500 Apr 05 11:44:19.040938 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 600/1185] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:18 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:19.768482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:19.769090 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:19.775542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:19.775994 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:19.776761 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:19.777194 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:19.917580 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:19.925462 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-ccac83ae-2d21-44d1-accd-a246cf7f425e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.161315 Apr 05 11:44:19.926046 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 586/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:19 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:20.057523 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:20.058098 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:20.064545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:20.064998 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:20.065764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:20.066198 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:20.202362 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:20.212370 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b66e1ef6-adeb-4819-afc5-07d06449ea80 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1315 microversion: 2.1 time: 0.158565 Apr 05 11:44:20.212966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 601/1187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:20 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:20.942555 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:20.943152 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:20.949564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:20.954890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:20.954890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:20.954890 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.083388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:21.090629 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-4afd33e2-8812-4984-a415-82b793212c5c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.152119 Apr 05 11:44:21.091201 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 587/1188] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:20 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:21.231701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:21.232306 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:21.239234 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.239790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.240565 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.241006 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.379334 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:21.386769 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14ad6426-d557-4eba-9775-f177a9601c9b tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1465 microversion: 2.1 time: 0.159060 Apr 05 11:44:21.387342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 602/1189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:21 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:21.426004 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:21.426493 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:21.432381 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.432861 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.433626 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.434057 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.457978 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:44:21.816617 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6f79c7dd-9772-45e1-876b-b06b1f661b46 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 204 len: 0 microversion: 2.1 time: 0.394715 Apr 05 11:44:21.817355 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 588/1190] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:44:21 2022] DELETE /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:44:21.825604 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:21.830545 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:21.833119 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.833571 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.834344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:21.834782 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:21.974078 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:21.981471 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1d3a4499-1e80-4372-8ede-1bd11c07c052 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1471 microversion: 2.1 time: 0.159714 Apr 05 11:44:21.982048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 603/1191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:21 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:22.108053 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:22.108753 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:22.115121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:22.115609 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:22.116374 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:22.116806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:22.252570 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:22.259876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-392e53a4-bd07-4ec9-8070-3eb49ce60b8b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.156150 Apr 05 11:44:22.260446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 589/1192] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:22 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:22.998406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:22.999022 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:23.005686 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:23.006141 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:23.006913 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:23.007349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:23.138908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:23.146996 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bc02e97b-6b40-499a-b746-381bb6ee5305 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1471 microversion: 2.1 time: 0.152492 Apr 05 11:44:23.147668 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 604/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:22 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:23.276901 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:23.277488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:23.284008 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:23.284455 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:23.285849 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:23.286326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:23.416807 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:23.424394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a0b81372-f2eb-4412-bf2c-b63b4b8ea908 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.151309 Apr 05 11:44:23.424965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 590/1194] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:23 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:23.792084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-b5666855-7e86-4132-882e-af81e42903fb req-0d6b525c-497f-403c-a3f7-d19a4771c597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524e514-20e8-46f6-a7c6-7d2e96e89d4e", "name": "network-vif-plugged", "status": "completed", "tag": "9f148526-7b17-4fe7-aa34-3b0c38b99339"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:23.806007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b5666855-7e86-4132-882e-af81e42903fb req-0d6b525c-497f-403c-a3f7-d19a4771c597 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:23.806007 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-b5666855-7e86-4132-882e-af81e42903fb req-0d6b525c-497f-403c-a3f7-d19a4771c597 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:23.816694 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-b5666855-7e86-4132-882e-af81e42903fb req-0d6b525c-497f-403c-a3f7-d19a4771c597 service nova] Creating event network-vif-plugged:9f148526-7b17-4fe7-aa34-3b0c38b99339 for instance a524e514-20e8-46f6-a7c6-7d2e96e89d4e on hv-cinder-83444 Apr 05 11:44:23.822299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-b5666855-7e86-4132-882e-af81e42903fb req-0d6b525c-497f-403c-a3f7-d19a4771c597 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034597 Apr 05 11:44:23.823004 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 605/1195] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:24.165443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:24.166155 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:24.173176 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:24.173757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:24.174621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:24.175147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:24.250029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:24.258556 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37168011-5183-4645-9701-7e68cfdc2ff1 tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1429 microversion: 2.1 time: 0.098799 Apr 05 11:44:24.259774 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 606/1196] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:24 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:24.275766 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-e90092af-abe3-44d8-bbff-5d2797e76ad8 req-974dcdc5-7a7c-4574-8cda-c262b75b98f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3499fa68-d897-41ee-99e5-ea8e9311fafe", "name": "network-vif-deleted", "tag": "829f1bcb-c135-4ba4-af8b-640f29281c32"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:24.284576 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e90092af-abe3-44d8-bbff-5d2797e76ad8 req-974dcdc5-7a7c-4574-8cda-c262b75b98f4 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:24.285231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-e90092af-abe3-44d8-bbff-5d2797e76ad8 req-974dcdc5-7a7c-4574-8cda-c262b75b98f4 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:24.298785 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-e90092af-abe3-44d8-bbff-5d2797e76ad8 req-974dcdc5-7a7c-4574-8cda-c262b75b98f4 service nova] Creating event network-vif-deleted:829f1bcb-c135-4ba4-af8b-640f29281c32 for instance 3499fa68-d897-41ee-99e5-ea8e9311fafe on hv-cinder-83444 Apr 05 11:44:24.304288 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-e90092af-abe3-44d8-bbff-5d2797e76ad8 req-974dcdc5-7a7c-4574-8cda-c262b75b98f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175209 Apr 05 11:44:24.304900 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 591/1197] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:44:24.441908 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:24.442416 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:24.449787 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:24.450454 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:24.451585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:24.452323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:24.590929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:24.598234 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-07f6da06-6c6a-48af-b094-3ecd4c2a25e0 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.161010 Apr 05 11:44:24.598809 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 607/1198] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:24 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:25.276712 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:25.277409 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:25.283809 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:25.284253 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:25.285015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:25.285670 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:25.316112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:25.316553 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:25.316998 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lazy-loading 'fault' on Instance uuid 3499fa68-d897-41ee-99e5-ea8e9311fafe {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:44:25.360499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af025ed0432442ecb2def6f9ebec7278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3259730fc078424085aab847a2b7ec52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:25.368914 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1026ccf3-64a6-4fcf-822b-d5a9088b830e tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 200 len: 1305 microversion: 2.1 time: 0.096393 Apr 05 11:44:25.369480 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 592/1199] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:25 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:25.616369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:25.617009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:25.623250 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:25.623930 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:25.624694 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:25.625126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:25.760922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:25.768546 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3f16a7c6-886e-45f4-bce1-1c506462ebff tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1319 microversion: 2.1 time: 0.156986 Apr 05 11:44:25.772738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 608/1200] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:25 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:26.387124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:26.387767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] [instance: 3499fa68-d897-41ee-99e5-ea8e9311fafe] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:26.394283 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:26.394732 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:26.395529 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:26.395966 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:26.409362 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] HTTP exception thrown: Instance 3499fa68-d897-41ee-99e5-ea8e9311fafe could not be found. Apr 05 11:44:26.414023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] Returning 404 to user: Instance 3499fa68-d897-41ee-99e5-ea8e9311fafe could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:44:26.414023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e2a66506-3f11-4a21-a512-31e6548a685c tempest-VolumesNegativeTest-1520131167 tempest-VolumesNegativeTest-1520131167-project] 10.222.0.60 "GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe" status: 404 len: 111 microversion: 2.1 time: 0.028380 Apr 05 11:44:26.414023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 593/1201] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:26 2022] GET /compute/v2.1/servers/3499fa68-d897-41ee-99e5-ea8e9311fafe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:44:26.785966 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:44:26.786503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:26.793222 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:26.793594 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:26.794379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:26.795084 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:26.935321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:44:26.943100 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2fb057f-1b9c-4bbe-9612-892e58386503 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1508 microversion: 2.1 time: 0.161017 Apr 05 11:44:26.943720 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 609/1202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:44:26 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:44:43.632947 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "817b43d6-2726-4b74-9f82-d6e7f716b589", "device": "/dev/sdb"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:44:43.634843 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:44:43.641012 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:43.641466 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:43.644443 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:44:43.644443 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:44:44.515168 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8e9da46b-e7d2-4113-9b55-2890daa07aa3 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "POST /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.885989 Apr 05 11:44:44.515724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 594/1203] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:44:43 2022] POST /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:10.181500 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:10.182044 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:10.187922 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:10.188371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:10.189134 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:10.189567 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:10.267672 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lazy-loading 'services' on Instance uuid a524e514-20e8-46f6-a7c6-7d2e96e89d4e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:45:10.545440 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e2a406e-b941-4537-8644-f947be35dd2a tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e/os-volume_attachments/817b43d6-2726-4b74-9f82-d6e7f716b589" status: 202 len: 0 microversion: 2.1 time: 0.368368 Apr 05 11:45:10.546043 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 610/1204] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:45:10 2022] DELETE /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e/os-volume_attachments/817b43d6-2726-4b74-9f82-d6e7f716b589 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:45:11.656177 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:11.660097 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:11.663326 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:11.663827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:11.666180 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:11.666624 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:11.692588 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:45:12.178482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-d495347a-43e2-49f7-b3fd-9b39b73bb7f5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 204 len: 0 microversion: 2.1 time: 0.526741 Apr 05 11:45:12.179077 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 595/1205] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:45:11 2022] DELETE /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:45:12.188530 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:12.189302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:12.197752 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:12.198210 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:12.198997 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:12.199601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:12.340443 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:12.347949 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c00e2ee0-0b89-425f-bcd8-57c0aefe703c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1514 microversion: 2.1 time: 0.163778 Apr 05 11:45:12.348533 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 611/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:12 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:13.366460 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:13.367278 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:13.374334 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:13.377070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:13.377070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:13.377070 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:13.507425 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:13.514742 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-0abba105-3b38-4b57-9ef8-dfc12ebc2266 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1514 microversion: 2.1 time: 0.152575 Apr 05 11:45:13.515306 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 596/1207] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:13 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:14.531704 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:14.532331 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:14.538969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:14.539627 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:14.541038 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:14.541490 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:14.606364 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:14.614321 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-186c352f-2bd7-4407-868f-d001f93e9fbb tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1472 microversion: 2.1 time: 0.086674 Apr 05 11:45:14.614915 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 612/1208] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:14 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:14.764836 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-f15f7c65-a765-4d14-8cfd-40d049b0ad20 req-82c370f0-55e1-40ae-b81e-169077dad22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524e514-20e8-46f6-a7c6-7d2e96e89d4e", "name": "network-vif-deleted", "tag": "9f148526-7b17-4fe7-aa34-3b0c38b99339"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:14.773469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f15f7c65-a765-4d14-8cfd-40d049b0ad20 req-82c370f0-55e1-40ae-b81e-169077dad22e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:14.781778 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-f15f7c65-a765-4d14-8cfd-40d049b0ad20 req-82c370f0-55e1-40ae-b81e-169077dad22e service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:14.784701 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-f15f7c65-a765-4d14-8cfd-40d049b0ad20 req-82c370f0-55e1-40ae-b81e-169077dad22e service nova] Creating event network-vif-deleted:9f148526-7b17-4fe7-aa34-3b0c38b99339 for instance a524e514-20e8-46f6-a7c6-7d2e96e89d4e on hv-cinder-83444 Apr 05 11:45:14.790172 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-f15f7c65-a765-4d14-8cfd-40d049b0ad20 req-82c370f0-55e1-40ae-b81e-169077dad22e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028470 Apr 05 11:45:14.790757 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 597/1209] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:15.630808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:15.631444 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:15.638427 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:15.640147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:15.640147 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:15.640349 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:15.675601 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:15.676110 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:15.676608 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lazy-loading 'fault' on Instance uuid a524e514-20e8-46f6-a7c6-7d2e96e89d4e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:45:15.724281 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:15.732503 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0542359c-2fbf-481a-ba2e-488357ad1c7b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 200 len: 1309 microversion: 2.1 time: 0.105510 Apr 05 11:45:15.733083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 613/1210] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:15 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:16.750770 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:16.751490 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: a524e514-20e8-46f6-a7c6-7d2e96e89d4e] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:16.757572 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:16.758015 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:16.759292 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:16.759816 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:16.772319 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] HTTP exception thrown: Instance a524e514-20e8-46f6-a7c6-7d2e96e89d4e could not be found. Apr 05 11:45:16.772891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Returning 404 to user: Instance a524e514-20e8-46f6-a7c6-7d2e96e89d4e could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:45:16.774176 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-9631ae44-a02f-4823-9df5-5d3f7b00b21b tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e" status: 404 len: 111 microversion: 2.1 time: 0.027625 Apr 05 11:45:16.775137 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 598/1211] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:16 2022] GET /compute/v2.1/servers/a524e514-20e8-46f6-a7c6-7d2e96e89d4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:45:25.162647 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-54539362", "imageRef": "c5da84c2-e375-4eea-95ee-fcd3195606ea", "flavorRef": "452", "networks": [{"uuid": "0e6ee671-44a9-446f-bc37-a1b71dd0faeb"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:25.214955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] validate_networks() for [('0e6ee671-44a9-446f-bc37-a1b71dd0faeb', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:45:25.555654 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:45:25.556089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:45:25.556569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:45:25.557139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:45:25.558124 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:45:25.566965 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:25.567437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:25.568251 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:25.568691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:25.585598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Getting quotas for project 0493643a9a404b79b3a8036cfc7df40b. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:45:25.590178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Getting quotas for user accca93ba1ae48818d9fce0012acda6e and project 0493643a9a404b79b3a8036cfc7df40b. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:45:25.600997 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:45:25.603243 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5da84c2-e375-4eea-95ee-fcd3195606ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:45:25.728585 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a568e8b6-f81e-4894-bdaf-444cc0da0198 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569780 Apr 05 11:45:25.729902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 614/1212] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:45:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:45:25.739820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1d172c98-f881-4c6e-b5bb-2264d9f47200 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:25.740423 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1d172c98-f881-4c6e-b5bb-2264d9f47200 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:25.795318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1d172c98-f881-4c6e-b5bb-2264d9f47200 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:25.802004 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1d172c98-f881-4c6e-b5bb-2264d9f47200 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1217 microversion: 2.1 time: 0.065984 Apr 05 11:45:25.802575 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 599/1213] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:25 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:26.819146 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:26.819799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:26.826449 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:26.826906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:26.827708 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:26.828152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:26.893344 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:26.901014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7f284a5-fc94-481e-ae9d-a5811cf34614 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1221 microversion: 2.1 time: 0.086274 Apr 05 11:45:26.901799 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 615/1214] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:26 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:27.919366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:27.920056 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:27.927366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:27.927850 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:27.928630 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:27.929073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:27.998231 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:28.005738 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-e9b383ba-5f87-49b8-93b7-8d84cc2aebc6 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1277 microversion: 2.1 time: 0.091462 Apr 05 11:45:28.012524 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 600/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:27 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:29.023989 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:29.024589 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:29.030912 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:29.031371 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:29.032178 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:29.032621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:29.165757 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:29.174075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-afc73f98-a373-49d6-b98d-3f249cb4ea48 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.153963 Apr 05 11:45:29.174681 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 616/1216] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:29 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:29.506446 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-9c5f7477-0484-48aa-8781-10e656842ec1 req-c94aa9c2-f19a-45d4-93d0-75d68dce3090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b7430e-ab40-408a-8e02-49ae4de262d2", "tag": "44a34c8a-def2-4e89-8d9d-b6d350fff1d0"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:29.515709 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9c5f7477-0484-48aa-8781-10e656842ec1 req-c94aa9c2-f19a-45d4-93d0-75d68dce3090 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:29.516155 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-9c5f7477-0484-48aa-8781-10e656842ec1 req-c94aa9c2-f19a-45d4-93d0-75d68dce3090 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:29.529346 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-9c5f7477-0484-48aa-8781-10e656842ec1 req-c94aa9c2-f19a-45d4-93d0-75d68dce3090 service nova] Creating event network-changed:44a34c8a-def2-4e89-8d9d-b6d350fff1d0 for instance b6b7430e-ab40-408a-8e02-49ae4de262d2 on hv-cinder-83444 Apr 05 11:45:29.533680 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-9c5f7477-0484-48aa-8781-10e656842ec1 req-c94aa9c2-f19a-45d4-93d0-75d68dce3090 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031225 Apr 05 11:45:29.534600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 601/1217] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:30.191937 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:30.192548 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:30.198808 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:30.199941 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:30.200719 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:30.201152 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:30.336302 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:30.344194 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9eae42e6-cfbd-4969-8229-b72a58333b8d tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.156122 Apr 05 11:45:30.344764 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 617/1218] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:30 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:31.362187 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:31.362881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:31.369459 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:31.369929 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:31.370737 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:31.371799 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:31.512815 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:31.520116 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-eac2b212-7eab-4ed4-bb9a-4fb01285cdb2 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.162168 Apr 05 11:45:31.520684 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 602/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:31 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:32.537765 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:32.538299 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:32.544952 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:32.545399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:32.546166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:32.546598 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:32.681317 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:32.689758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a576081b-41a6-4ee6-9664-659cfbbad25c tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.155947 Apr 05 11:45:32.690322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 618/1220] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:32 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:33.706430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:33.707023 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:33.713401 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:33.713853 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:33.714618 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:33.715676 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:33.847114 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:33.854345 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8b0dbe02-868b-4d46-bfff-76970919ae7e tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.151806 Apr 05 11:45:33.854938 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 603/1221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:33 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:34.871396 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:34.872029 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:34.878691 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:34.879137 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:34.879931 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:34.893391 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:35.015291 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:35.022685 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d3620529-1c8b-474f-998d-75ee96782aa7 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.155407 Apr 05 11:45:35.023256 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 619/1222] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:34 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:36.039492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:36.040132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:36.046827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:36.047284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:36.048088 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:36.048525 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:36.180208 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:36.188039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-5cc552f7-aa46-459c-ad95-62c422f0eef4 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.152459 Apr 05 11:45:36.188621 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 604/1223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:36 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:36.455483 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-176b0cec-435d-4fdf-86cf-f8e5320fd76f req-9fa426b4-5dab-4ea5-959b-ca5ddbddeb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7430e-ab40-408a-8e02-49ae4de262d2", "name": "network-vif-plugged", "status": "completed", "tag": "44a34c8a-def2-4e89-8d9d-b6d350fff1d0"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:36.463276 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-176b0cec-435d-4fdf-86cf-f8e5320fd76f req-9fa426b4-5dab-4ea5-959b-ca5ddbddeb9b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:36.463758 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-176b0cec-435d-4fdf-86cf-f8e5320fd76f req-9fa426b4-5dab-4ea5-959b-ca5ddbddeb9b service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:36.475246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-176b0cec-435d-4fdf-86cf-f8e5320fd76f req-9fa426b4-5dab-4ea5-959b-ca5ddbddeb9b service nova] Creating event network-vif-plugged:44a34c8a-def2-4e89-8d9d-b6d350fff1d0 for instance b6b7430e-ab40-408a-8e02-49ae4de262d2 on hv-cinder-83444 Apr 05 11:45:36.480258 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-176b0cec-435d-4fdf-86cf-f8e5320fd76f req-9fa426b4-5dab-4ea5-959b-ca5ddbddeb9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190044 Apr 05 11:45:36.480844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 620/1224] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:37.205335 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:37.205954 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:37.212296 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:37.215723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:37.215723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:37.215723 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:37.353399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:37.361499 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8c9bad03-5c95-442d-989e-a62c27d13977 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1317 microversion: 2.1 time: 0.160193 Apr 05 11:45:37.362066 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 605/1225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:37 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:38.379741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:38.380450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:38.386596 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:38.387048 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:38.387883 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:38.388322 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:38.526000 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:38.533969 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-162d217e-d257-4ed3-91b9-981e20b8f0c8 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1507 microversion: 2.1 time: 0.159150 Apr 05 11:45:38.534543 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 621/1226] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:38 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:38.550623 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e634f47f-8381-4228-be0b-3c6ece66c480", "device": "/dev/sdb"}} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:38.551711 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:38.557955 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:38.558410 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:38.559203 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:38.559655 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:39.244310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-49b0253d-eccf-4344-8ead-178114fb5f37 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "POST /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697618 Apr 05 11:45:39.244905 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 606/1227] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Apr 5 11:45:38 2022] POST /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:53.084898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-242393439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098956905", "security_groups": [{"name": "tempest-secgroup-smoke-1021731976"}], "block_device_mapping_v2": [{"uuid": "0aec26c6-9c78-4a86-874c-4e36c2b1cf77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6351c4b7-133d-4471-82de-f39f3c9f175f"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:53.194192 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] validate_networks() for [('6351c4b7-133d-4471-82de-f39f3c9f175f', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:45:53.576246 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:45:53.576713 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:45:53.577175 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:45:53.577579 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:45:53.577986 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:45:53.587701 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:53.588149 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:53.588947 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:53.589379 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:53.605794 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:45:53.609583 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Getting quotas for user 3b1109ba42564e7fb2e1e831fdc09280 and project 0bfd09739367451297d7d3042eb37411. Resources: {'instances', 'cores', 'ram'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:45:53.666431 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:45:53.668575 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0aec26c6-9c78-4a86-874c-4e36c2b1cf77',volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:45:54.070902 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3e86f88-d5e7-4bbb-b1e2-d49fef3610d7 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989821 Apr 05 11:45:54.071510 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 622/1228] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Apr 5 11:45:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:45:54.082591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-73dacc8d-8c36-4a20-9aa2-73bf5fd4f261 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:54.083843 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-73dacc8d-8c36-4a20-9aa2-73bf5fd4f261 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:54.140388 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-73dacc8d-8c36-4a20-9aa2-73bf5fd4f261 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:54.147681 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-73dacc8d-8c36-4a20-9aa2-73bf5fd4f261 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1094 microversion: 2.1 time: 0.069752 Apr 05 11:45:54.148241 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 607/1229] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:54 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:55.165740 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:55.166562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:55.173166 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:55.173648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:55.174652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:55.175091 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:55.233354 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:55.240617 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-803f4739-8366-4eaf-8288-d03aac7b2a58 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1144 microversion: 2.1 time: 0.079328 Apr 05 11:45:55.241199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 623/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:55 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:56.258359 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:56.258965 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:56.266197 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:56.266640 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:56.267394 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:56.267852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:56.326120 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:56.335038 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-52650cec-08f2-4799-ba29-5c78d6d9d521 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1144 microversion: 2.1 time: 0.081263 Apr 05 11:45:56.335647 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 608/1231] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:56 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:57.352245 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:57.352863 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:57.359120 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:57.359613 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:57.360369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:57.360798 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:57.421111 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:57.429090 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d6945cb-68dd-46f0-acf0-5d5328bf70cb tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1192 microversion: 2.1 time: 0.080671 Apr 05 11:45:57.429667 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 624/1232] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:57 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:45:58.446097 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:58.446718 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:58.453044 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:58.453492 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:58.454290 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:58.454724 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:58.522779 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:58.530252 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6f9b7101-989b-4c24-8d9f-6f321ca453e1 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1210 microversion: 2.1 time: 0.087950 Apr 05 11:45:58.531190 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 609/1233] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:58 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:45:59.548515 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:45:59.549131 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:45:59.557676 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:59.558499 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:59.559372 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:59.560039 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:59.573542 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-859b556e-f4e6-431f-b59d-31cb1f3820c7 req-aa73774f-16a6-4fe7-80c7-648bdf2d3251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976aafc8-5287-4cd6-abfb-a138ce81ce35", "tag": "a8debfa0-1854-4a59-8ee7-7e56b90465ea"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:45:59.584682 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-859b556e-f4e6-431f-b59d-31cb1f3820c7 req-aa73774f-16a6-4fe7-80c7-648bdf2d3251 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:45:59.585132 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-859b556e-f4e6-431f-b59d-31cb1f3820c7 req-aa73774f-16a6-4fe7-80c7-648bdf2d3251 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:45:59.602754 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-859b556e-f4e6-431f-b59d-31cb1f3820c7 req-aa73774f-16a6-4fe7-80c7-648bdf2d3251 service nova] Creating event network-changed:a8debfa0-1854-4a59-8ee7-7e56b90465ea for instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 on hv-cinder-83444 Apr 05 11:45:59.608146 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-859b556e-f4e6-431f-b59d-31cb1f3820c7 req-aa73774f-16a6-4fe7-80c7-648bdf2d3251 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040054 Apr 05 11:45:59.609205 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 610/1234] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:45:59.727818 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:45:59.735342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4bf4b749-d3f7-4af0-ac8c-7007e893d708 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.190598 Apr 05 11:45:59.736019 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 625/1235] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:45:59 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:00.753641 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:00.754376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:00.760626 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:00.761078 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:00.761874 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:00.762311 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:00.900222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:00.907552 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-26022889-47cf-4779-936d-3e293c89fc2f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.158593 Apr 05 11:46:00.908121 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 611/1236] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:00 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:01.218406 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:01.218909 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:01.225750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:01.226199 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:01.226962 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:01.227397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:01.303837 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lazy-loading 'services' on Instance uuid b6b7430e-ab40-408a-8e02-49ae4de262d2 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:46:01.525541 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c20d9117-7ab1-4581-a988-d8c54f462514 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2/os-volume_attachments/e634f47f-8381-4228-be0b-3c6ece66c480" status: 202 len: 0 microversion: 2.1 time: 0.310815 Apr 05 11:46:01.526223 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 626/1237] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Apr 5 11:46:01 2022] DELETE /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2/os-volume_attachments/e634f47f-8381-4228-be0b-3c6ece66c480 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:46:01.925216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:01.925834 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:01.933112 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:01.933591 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:01.934357 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:01.934786 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:02.070767 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:02.078247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-3a38ccf2-90b6-4b75-b86a-71150b7eeb0a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.156828 Apr 05 11:46:02.078858 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 612/1238] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:01 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:02.635369 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:02.636384 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:02.642862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:02.650929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:02.650929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:02.650929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:02.671982 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:46:02.988539 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f367b41f-91a0-463c-956e-275c58099324 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 204 len: 0 microversion: 2.1 time: 0.358644 Apr 05 11:46:02.989129 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 627/1239] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:46:02 2022] DELETE /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:46:02.997217 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:02.997834 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:03.004375 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:03.005243 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:03.005573 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:03.006806 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:03.095562 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:03.096280 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:03.103835 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:03.104297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:03.105236 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:03.106689 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:03.143909 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:03.151981 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a196f25b-371a-4d83-8a48-ef6408f50794 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1513 microversion: 2.1 time: 0.158623 Apr 05 11:46:03.152559 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 613/1240] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:02 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:03.251087 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:03.259067 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6cee2513-d325-42b9-8868-2bbc7d583453 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.167745 Apr 05 11:46:03.259668 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 628/1241] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:03 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:46:04.169590 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:04.170117 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:04.176467 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:04.176920 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:04.177852 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:04.178329 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:04.276440 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:04.277060 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:04.283389 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:04.283882 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:04.284652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:04.285089 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:04.313914 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:04.321927 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-be550e3b-f4a4-4c46-86d4-7268040d3c07 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1513 microversion: 2.1 time: 0.156561 Apr 05 11:46:04.322504 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 614/1242] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:04 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:04.422728 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:04.430770 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40d239cf-cb53-48bf-af25-0e3769fe859a tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.158304 Apr 05 11:46:04.431347 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 629/1243] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:04 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:46:05.339996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:05.340597 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:05.346762 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:05.347202 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:05.348041 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:05.348482 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:05.364393 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-66df672a-626b-4ca8-88f9-453173776089 req-accddef8-99e1-40f1-ae5a-6d9dbfeccb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7430e-ab40-408a-8e02-49ae4de262d2", "name": "network-vif-deleted", "tag": "44a34c8a-def2-4e89-8d9d-b6d350fff1d0"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:46:05.373242 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-66df672a-626b-4ca8-88f9-453173776089 req-accddef8-99e1-40f1-ae5a-6d9dbfeccb86 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:05.373714 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-66df672a-626b-4ca8-88f9-453173776089 req-accddef8-99e1-40f1-ae5a-6d9dbfeccb86 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:05.386399 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-66df672a-626b-4ca8-88f9-453173776089 req-accddef8-99e1-40f1-ae5a-6d9dbfeccb86 service nova] Creating event network-vif-deleted:44a34c8a-def2-4e89-8d9d-b6d350fff1d0 for instance b6b7430e-ab40-408a-8e02-49ae4de262d2 on hv-cinder-83444 Apr 05 11:46:05.395341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-66df672a-626b-4ca8-88f9-453173776089 req-accddef8-99e1-40f1-ae5a-6d9dbfeccb86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031166 Apr 05 11:46:05.395341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 630/1244] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:46:05.417950 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:05.425571 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-aace68e9-d4f7-4160-a7d7-2baf11e047ee tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1471 microversion: 2.1 time: 0.089731 Apr 05 11:46:05.426148 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 615/1245] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:05 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:46:05.447652 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:05.448356 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:05.454504 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:05.454955 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:05.455750 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:05.456187 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:05.603948 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:05.611292 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7979229e-7fd9-40ed-a76c-2067899eee99 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.167939 Apr 05 11:46:05.611898 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 631/1246] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:05 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:06.444606 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:06.445222 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:06.451540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:06.451993 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:06.452760 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:06.453196 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:06.483646 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:06.484095 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:06.484540 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lazy-loading 'fault' on Instance uuid b6b7430e-ab40-408a-8e02-49ae4de262d2 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:46:06.525373 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accca93ba1ae48818d9fce0012acda6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0493643a9a404b79b3a8036cfc7df40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:06.532817 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-804b76e4-f418-4f8e-a9de-59f7bc33f3be tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 200 len: 1307 microversion: 2.1 time: 0.092774 Apr 05 11:46:06.533376 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 616/1247] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:06 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:06.628324 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:06.628876 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:06.635330 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:06.636139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:06.636641 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:06.637083 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:06.770678 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:06.778733 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d9daaefd-cdc4-45e6-809d-c2f466632d10 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.154280 Apr 05 11:46:06.779329 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 632/1248] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:06 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:07.557720 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:07.558365 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] [instance: b6b7430e-ab40-408a-8e02-49ae4de262d2] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:07.564664 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:07.565128 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:07.565891 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:07.566331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:07.580014 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] HTTP exception thrown: Instance b6b7430e-ab40-408a-8e02-49ae4de262d2 could not be found. Apr 05 11:46:07.580611 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] Returning 404 to user: Instance b6b7430e-ab40-408a-8e02-49ae4de262d2 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:46:07.581461 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-37b06364-dbc7-4bc3-b54c-cccd7d04cac5 tempest-VolumesSnapshotTestJSON-1627912870 tempest-VolumesSnapshotTestJSON-1627912870-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2" status: 404 len: 111 microversion: 2.1 time: 0.027617 Apr 05 11:46:07.581994 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 617/1249] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:07 2022] GET /compute/v2.1/servers/b6b7430e-ab40-408a-8e02-49ae4de262d2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:46:07.796778 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:07.797403 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:07.804620 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:07.805076 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:07.805854 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:07.806297 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:07.946580 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:07.954068 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1140e0cd-85f5-4db5-8498-8fe139107146 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.161340 Apr 05 11:46:07.954648 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 633/1250] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:07 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:08.970860 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:08.971494 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:08.977977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:08.978430 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:08.979227 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:08.979693 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:09.117069 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:09.124607 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-6667b366-c48e-479a-a6d3-3f29de7102ee tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.157707 Apr 05 11:46:09.125178 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 618/1251] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:08 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:10.142414 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:10.143014 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:10.150114 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:10.150559 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:10.151318 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:10.151773 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:10.286450 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:10.294743 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40d156be-b6db-4dbf-959b-156d0109a115 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.156142 Apr 05 11:46:10.295312 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 634/1252] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:10 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:11.312516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:11.313149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:11.320769 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:11.321215 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:11.322005 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:11.322469 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:11.475464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:11.483074 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b9e9c6c3-01de-45ea-9493-90a96aecf158 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.174363 Apr 05 11:46:11.483674 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 619/1253] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:11 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:12.128460 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-6505690d-0e58-4260-9f3f-48ff9af374fc req-26c93bde-25cb-40eb-b763-700df476b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976aafc8-5287-4cd6-abfb-a138ce81ce35", "name": "network-vif-plugged", "status": "completed", "tag": "a8debfa0-1854-4a59-8ee7-7e56b90465ea"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:46:12.138610 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6505690d-0e58-4260-9f3f-48ff9af374fc req-26c93bde-25cb-40eb-b763-700df476b0d8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:12.139397 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6505690d-0e58-4260-9f3f-48ff9af374fc req-26c93bde-25cb-40eb-b763-700df476b0d8 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:12.152804 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-6505690d-0e58-4260-9f3f-48ff9af374fc req-26c93bde-25cb-40eb-b763-700df476b0d8 service nova] Creating event network-vif-plugged:a8debfa0-1854-4a59-8ee7-7e56b90465ea for instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 on hv-cinder-83444 Apr 05 11:46:12.157519 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-6505690d-0e58-4260-9f3f-48ff9af374fc req-26c93bde-25cb-40eb-b763-700df476b0d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Apr 05 11:46:12.158139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 635/1254] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:46:12.502076 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:12.502691 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:12.509213 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:12.509669 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:12.510436 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:12.510876 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:12.644476 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:12.652580 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-8479aa37-9606-40eb-81f1-0dc028c57558 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.154386 Apr 05 11:46:12.653149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 620/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:12 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:13.670823 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:13.671638 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:13.677773 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:13.678383 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:13.679162 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:13.679642 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:13.818352 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:13.827595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9593ee02-df5d-4feb-bd51-f2d745328ce8 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1266 microversion: 2.1 time: 0.159868 Apr 05 11:46:13.832097 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 636/1256] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:13 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:14.845642 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:14.846254 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:14.853124 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:14.853577 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:14.854343 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:14.854827 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:14.986997 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:14.995021 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1531b2f3-e002-430d-ba68-fedc368d2238 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1454 microversion: 2.1 time: 0.153360 Apr 05 11:46:14.995630 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 621/1257] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:14 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:15.011093 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:46:15.011738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:46:15.018151 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:15.018605 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:15.019387 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:15.019851 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:15.152572 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:46:15.160002 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cc6f5e0e-edf1-44e5-9773-2b6b9350de1d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1454 microversion: 2.1 time: 0.152687 Apr 05 11:46:15.160570 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 637/1258] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:46:15 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:46:17.316389 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-1ca264c3-3843-424d-92b2-1903e272e14f req-7e01e070-a51e-4d6a-b7ea-ccae09257846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976aafc8-5287-4cd6-abfb-a138ce81ce35", "tag": "a8debfa0-1854-4a59-8ee7-7e56b90465ea"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:46:17.325073 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1ca264c3-3843-424d-92b2-1903e272e14f req-7e01e070-a51e-4d6a-b7ea-ccae09257846 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:46:17.325516 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-1ca264c3-3843-424d-92b2-1903e272e14f req-7e01e070-a51e-4d6a-b7ea-ccae09257846 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:46:17.337086 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-1ca264c3-3843-424d-92b2-1903e272e14f req-7e01e070-a51e-4d6a-b7ea-ccae09257846 service nova] Creating event network-changed:a8debfa0-1854-4a59-8ee7-7e56b90465ea for instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 on hv-cinder-83444 Apr 05 11:46:17.342310 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-1ca264c3-3843-424d-92b2-1903e272e14f req-7e01e070-a51e-4d6a-b7ea-ccae09257846 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100871 Apr 05 11:46:17.343127 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 622/1259] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:47:12.914923 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:47:12.915673 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:47:23.543334 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:47:23.543943 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:47:45.665274 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:45.665929 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:45.667485 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [req-2635a432-3416-4bdb-b197-9c0250272e80 req-474a08a3-587f-4e09-9a1e-2c516fac17e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976aafc8-5287-4cd6-abfb-a138ce81ce35", "tag": "a8debfa0-1854-4a59-8ee7-7e56b90465ea"}]} {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:47:45.671862 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:45.672323 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:45.673123 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:45.674150 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:45.677041 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-2635a432-3416-4bdb-b197-9c0250272e80 req-474a08a3-587f-4e09-9a1e-2c516fac17e9 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:45.677547 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [req-2635a432-3416-4bdb-b197-9c0250272e80 req-474a08a3-587f-4e09-9a1e-2c516fac17e9 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:45.688747 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.compute.server_external_events [req-2635a432-3416-4bdb-b197-9c0250272e80 req-474a08a3-587f-4e09-9a1e-2c516fac17e9 service nova] Creating event network-changed:a8debfa0-1854-4a59-8ee7-7e56b90465ea for instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 on hv-cinder-83444 Apr 05 11:47:45.694562 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [req-2635a432-3416-4bdb-b197-9c0250272e80 req-474a08a3-587f-4e09-9a1e-2c516fac17e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Apr 05 11:47:45.701006 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 623/1260] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:47:45.701741 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:47:46.040486 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7fc0c0ce-12cd-4c36-b40a-9fac38a9ac9b tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "DELETE /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 204 len: 0 microversion: 2.1 time: 0.380993 Apr 05 11:47:46.041123 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 638/1261] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:47:45 2022] DELETE /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:47:46.049869 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:46.061192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:46.061192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:46.061192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:46.061192 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:46.061598 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:46.194247 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:46.201750 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-2dd8b158-b8dc-4d07-88f7-22e30b16625d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1578 microversion: 2.1 time: 0.156163 Apr 05 11:47:46.202318 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 624/1262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:46 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:47.221139 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:47.221869 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:47.228154 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:47.228595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:47.229351 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:47.229780 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:47.371658 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:47.380009 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e6f4254-b4f8-4b6e-b34d-64b4126db904 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1578 microversion: 2.1 time: 0.163109 Apr 05 11:47:47.380917 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 639/1263] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:47 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:48.398102 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:48.398715 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:48.405143 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:48.405599 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:48.406371 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:48.406810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:48.624195 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:48.632244 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-894c4415-f8e3-48a1-9e4a-63b036881f8f tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1460 microversion: 2.1 time: 0.238047 Apr 05 11:47:48.632810 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 625/1264] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:48 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1460 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:48.787195 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-73ce50bc-3c41-4fb3-88ad-09c522832f20 req-3c2dab72-fe2e-453b-b58d-99d7dec7d3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976aafc8-5287-4cd6-abfb-a138ce81ce35", "name": "network-vif-deleted", "tag": "a8debfa0-1854-4a59-8ee7-7e56b90465ea"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:47:48.795841 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-73ce50bc-3c41-4fb3-88ad-09c522832f20 req-3c2dab72-fe2e-453b-b58d-99d7dec7d3f5 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:48.796286 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-73ce50bc-3c41-4fb3-88ad-09c522832f20 req-3c2dab72-fe2e-453b-b58d-99d7dec7d3f5 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:48.807958 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-73ce50bc-3c41-4fb3-88ad-09c522832f20 req-3c2dab72-fe2e-453b-b58d-99d7dec7d3f5 service nova] Creating event network-vif-deleted:a8debfa0-1854-4a59-8ee7-7e56b90465ea for instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 on hv-cinder-83444 Apr 05 11:47:48.812790 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-73ce50bc-3c41-4fb3-88ad-09c522832f20 req-3c2dab72-fe2e-453b-b58d-99d7dec7d3f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Apr 05 11:47:48.813377 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 640/1265] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:47:49.649284 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:49.649828 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:49.656140 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:49.656593 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:49.657445 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:49.658399 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:49.689022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:49.689464 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:49.689910 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.objects.instance [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lazy-loading 'fault' on Instance uuid 976aafc8-5287-4cd6-abfb-a138ce81ce35 {{(pid=124243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:47:49.730157 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:49.737710 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-879cb008-0a39-480a-a852-9d10f6a85e3e tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 200 len: 1230 microversion: 2.1 time: 0.092413 Apr 05 11:47:49.738280 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 626/1266] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:49 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:50.755665 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:50.757595 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 976aafc8-5287-4cd6-abfb-a138ce81ce35] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:50.763759 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:50.764229 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:50.765023 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:50.765501 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:50.778983 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] HTTP exception thrown: Instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 could not be found. Apr 05 11:47:50.779603 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Returning 404 to user: Instance 976aafc8-5287-4cd6-abfb-a138ce81ce35 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:47:50.780430 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-949f830c-f818-4180-8b33-393cdc19e2a3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35" status: 404 len: 111 microversion: 2.1 time: 0.029556 Apr 05 11:47:50.780976 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 641/1267] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:50 2022] GET /compute/v2.1/servers/976aafc8-5287-4cd6-abfb-a138ce81ce35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:47:54.255341 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-38e294b9-3b13-4551-a238-34decc579235 req-281699dc-3b50-4640-aecc-45a1307d17d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514febd1-349b-4439-8ba2-62889b067381", "tag": "449dbab4-b7db-4b76-9262-6f3cd9a7eae2"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:47:54.256432 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:54.256996 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:54.267331 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:54.267829 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:54.267981 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-38e294b9-3b13-4551-a238-34decc579235 req-281699dc-3b50-4640-aecc-45a1307d17d1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:54.268423 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-38e294b9-3b13-4551-a238-34decc579235 req-281699dc-3b50-4640-aecc-45a1307d17d1 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:54.268877 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:54.269868 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:54.280136 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-38e294b9-3b13-4551-a238-34decc579235 req-281699dc-3b50-4640-aecc-45a1307d17d1 service nova] Creating event network-changed:449dbab4-b7db-4b76-9262-6f3cd9a7eae2 for instance 514febd1-349b-4439-8ba2-62889b067381 on hv-cinder-83444 Apr 05 11:47:54.285621 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-38e294b9-3b13-4551-a238-34decc579235 req-281699dc-3b50-4640-aecc-45a1307d17d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034380 Apr 05 11:47:54.286492 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 642/1268] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:47:54.296245 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Going to try to terminate instance {{(pid=124243) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:47:54.671235 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-a35abafb-6728-40dc-9fbf-58fcae8faffe tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "DELETE /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 204 len: 0 microversion: 2.1 time: 0.424581 Apr 05 11:47:54.676159 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 627/1269] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:47:54 2022] DELETE /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:47:54.683844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:54.683844 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:54.688990 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:54.689547 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:54.690373 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:54.690988 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:54.840088 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:54.848126 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-754eb48b-e7a8-4532-a3a3-7da57d21deff tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1579 microversion: 2.1 time: 0.170606 Apr 05 11:47:54.848696 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 643/1270] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:54 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:55.866305 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:55.867020 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:55.873366 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:55.873820 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:55.874592 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:55.875033 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:56.018207 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:56.025812 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-50813736-02b9-4627-8dc5-62696de88ad0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1579 microversion: 2.1 time: 0.163760 Apr 05 11:47:56.026385 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 628/1271] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:55 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:56.927388 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-9fc3b1da-78fa-4452-925c-59144b33e478 req-d75ea4ab-75f7-41a4-a8c0-fd14f38d1250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514febd1-349b-4439-8ba2-62889b067381", "name": "network-vif-deleted", "tag": "449dbab4-b7db-4b76-9262-6f3cd9a7eae2"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:47:56.952293 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9fc3b1da-78fa-4452-925c-59144b33e478 req-d75ea4ab-75f7-41a4-a8c0-fd14f38d1250 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:56.952745 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9fc3b1da-78fa-4452-925c-59144b33e478 req-d75ea4ab-75f7-41a4-a8c0-fd14f38d1250 service nova] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:56.966495 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-9fc3b1da-78fa-4452-925c-59144b33e478 req-d75ea4ab-75f7-41a4-a8c0-fd14f38d1250 service nova] Creating event network-vif-deleted:449dbab4-b7db-4b76-9262-6f3cd9a7eae2 for instance 514febd1-349b-4439-8ba2-62889b067381 on hv-cinder-83444 Apr 05 11:47:56.972075 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-9fc3b1da-78fa-4452-925c-59144b33e478 req-d75ea4ab-75f7-41a4-a8c0-fd14f38d1250 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052408 Apr 05 11:47:56.972673 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 644/1272] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Apr 5 11:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:47:57.043497 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:57.044109 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:57.051405 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:57.051830 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:57.052601 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:57.053039 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:57.112881 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.policy [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124243) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:57.120421 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-1fc231d8-dc75-43c3-8607-650acd111153 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1393 microversion: 2.1 time: 0.080888 Apr 05 11:47:57.120990 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 629/1273] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:57 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1393 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:58.138722 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:58.139342 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:58.146315 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:58.146777 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:58.147600 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:58.148050 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:58.178015 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:58.178473 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:58.178924 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lazy-loading 'fault' on Instance uuid 514febd1-349b-4439-8ba2-62889b067381 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:47:58.218729 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1109ba42564e7fb2e1e831fdc09280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfd09739367451297d7d3042eb37411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:47:58.227301 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4029f5d6-480d-4dbd-8a92-4ed18387391d tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 200 len: 1231 microversion: 2.1 time: 0.093363 Apr 05 11:47:58.227906 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 645/1274] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:58 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:47:59.244532 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:59.245149 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: 514febd1-349b-4439-8ba2-62889b067381] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:59.251521 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.251977 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.252752 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.253186 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.266353 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] HTTP exception thrown: Instance 514febd1-349b-4439-8ba2-62889b067381 could not be found. Apr 05 11:47:59.266939 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Returning 404 to user: Instance 514febd1-349b-4439-8ba2-62889b067381 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:47:59.268600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-646a269d-8ca7-46c3-b7ba-c380778d1b74 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381" status: 404 len: 111 microversion: 2.1 time: 0.027174 Apr 05 11:47:59.268600 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 630/1275] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:59 2022] GET /compute/v2.1/servers/514febd1-349b-4439-8ba2-62889b067381 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:47:59.835164 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:59.835738 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:59.841985 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.842437 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.843212 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.843677 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.856944 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] HTTP exception thrown: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. Apr 05 11:47:59.857529 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Returning 404 to user: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:47:59.858347 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8123ff4-7470-4295-a40d-45044b6868e3 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 404 len: 111 microversion: 2.1 time: 0.027932 Apr 05 11:47:59.858871 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 646/1276] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Apr 5 11:47:59 2022] DELETE /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:47:59.867022 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '>' {{(pid=124243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:47:59.867666 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.compute.api [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] [instance: e1d592d6-a3fa-42be-8e0d-81b3932cf139] Fetching instance by UUID {{(pid=124243) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:47:59.873557 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.874013 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.874774 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:47:59.875212 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG oslo_concurrency.lockutils [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Lock "0d1e9390-dac2-4a96-b2c9-7d781dfaf2dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:47:59.888571 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.wsgi [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] HTTP exception thrown: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. Apr 05 11:47:59.889154 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: DEBUG nova.api.openstack.wsgi [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Returning 404 to user: Instance e1d592d6-a3fa-42be-8e0d-81b3932cf139 could not be found. {{(pid=124243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:47:59.889968 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO nova.api.openstack.requestlog [None req-b2689be1-5556-43cb-b561-ea627cc73ebd tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139" status: 404 len: 111 microversion: 2.1 time: 0.026772 Apr 05 11:47:59.890488 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: [pid: 124243|app: 0|req: 631/1277] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Apr 5 11:47:59 2022] GET /compute/v2.1/servers/e1d592d6-a3fa-42be-8e0d-81b3932cf139 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:48:01.392588 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dc624e37-d445-4e52-afa8-bad518ee5ff0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] Calling method '.version_select at 0x7f1382aa4d30>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:48:01.480653 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dc624e37-d445-4e52-afa8-bad518ee5ff0 tempest-TestVolumeBootPattern-2040074858 tempest-TestVolumeBootPattern-2040074858-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2098956905" status: 202 len: 0 microversion: 2.1 time: 0.091930 Apr 05 11:48:01.481284 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 647/1278] 10.222.0.60 () {58 vars in 1262 bytes} [Tue Apr 5 11:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2098956905 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:48:49.778651 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:48:49.779363 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:49:05.779395 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:49:05.780044 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:49:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:50:32.923564 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:50:32.924293 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:50:43.552134 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:50:43.552755 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:50:49.443659 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:50:49.444216 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:51:00.958881 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:51:00.959373 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:52:09.789850 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:52:09.790569 dv-cinder-834448-3-iscsi devstack@n-api.service[124242]: Tue Apr 5 11:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:52:25.787785 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:52:25.788316 dv-cinder-834448-3-iscsi devstack@n-api.service[124243]: Tue Apr 5 11:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!